There's nothing boyishly charming about joining "the league." You're more likely to get laid kicking puppies than you are by being into fantasy football. Ask any woman. You probably look down on those Magic: the Gathering freaks and World of Warcraft weirdos, but at least those guys know they're social pariahs. They don't go around bragging about their pitiful hobby.
Fantasy football guys make a production out of the draft day party, donning NFL jerseys like live action role players in velvet capes and Medieval Teutonics. Blast LARP kids all you want but at least they're getting some exercise out there in the woods and, occasionally, interacting with girls.