It's interesting because sunlight makes most people happier, because sunlight increases dopamine levels and makes everyone happier. If I'm hot I simply turn on the a/c, grab a nice cold drink, etc.
The driving issue is understandable, but say between 10 AM and and 4 PM is ideal for sunlight.