I am with Visual Studio here.. It is a really powerful and polished tool..
The vanilla IDE without any addons has some unnecessary flaws already mentioned but plugins like VAX really make it one of the best IDE available... It disappoints me in very little, and now and then it crashes just while editing files losing me some progress for no reason, but what can I do, its still one of the best solutions.
When I don't use VS I usually use C::B but I am absolutely not a fan of it. Its pretty intuitive overally but the UI is a bit cranky and unpolished. Also I hate its project tree. Otherwise I am fine with it for programming less extensive projects!
And.. the worst IDE I ever used was XCode. I am sorry apple fanboys, but I just hate it and find it incredibly cranky and messy and not intuitive for a developer tool. Even though I find it pretty feature complete and interesting, its usage blows my nerves
Just my little opinion