Yes, the weather is one of my biggest challenges. A perfect day on the bike is when I pick the right amount of clothes to within a variance of 5°C-- I always err on the side of being too hot. The energy expended on being too cold, plus that ligament, the one that's hidden behind the back of my knee (it starts to click with every pedal stroke) is enough for me to stop ridding permanently. Seriously, it takes me the longest time to recover from being too cold.
-- so I sympathize.
FP........................................................