Lil B doesn't make it easy. He doesn't just troll those souls still uncomfortable with the concept of homosexuality; if anything, backpedaling on his I'm Gay album with a subtitle (I'm Happy) made him seem more like a standard troll and less like the master of head-games he'd presented previously. But his real art is that of the unapologetic weirdo, one who managed to reach a critical mass of Internet attention without ever really producing music that had a chance of crossing over.
There are legitimate reasons to be frustrated. In some corners of the Internet, he became more meme than musician, a lazy comedian's way to get a laugh without making a joke. And some will always be suspicious that a weirdo-rapper's fans are fetishizing his wackiness, rather than genuinely enjoying the art he creates.
But Lil B made some great music, at least for a period, and did push against the boundaries of what people thought possible in hip-hop, even breaking down the physical act of rapping. It can't be said that Lil B didn't deserve criticism; after all, his art was designed to provoke reactions at almost every level. But the haters who wrote off a genuinely unique artist missed some of the possibilities he opened up and questions he helped raise.