This is from personal experience. The very last thing you want to contend with when re-learning how to ride a bike (which is basically what riding fixed is) is rush-hour traffic. Late night can be iffy sometimes—definitely do NOT take this to mean 1 a.m. on a Friday—but pre-rush in the morning is good. Think sunrise.
Ride late at night or early in the morning.