There's not much to do outside in the cold, unless you're a skier, have a snow mobile, or go for a walk. All my outdoor activities include, playing ball, golf, beach, just chilling in the sun, swimming, fishing (ice fishing sucks)
I rarely wear layers. 20 degrees I'm still in a hoodie. I wear gym shorts almost everywhere, to go shopping, out to eat, bar etc...