it's because minimum temps are determined by things other than heat, like humidity, urban heat island, etc. Also, I tangibly feel hotter when there are more hot days. The summers that stay in my memory the longest are the ones with no breaks and the most number of hot days.