I probably wouldn't fly below 0F.
Fly in cold weather shouldn't be a problem, the main thing to watch is battery life, so don't try extreme flights. If the batteries are kept warm in the car, and then tossed in and flying relatively quickly, they will self-heat and should have nearly normal...