Well... there's no reason why a default SFML build wouldn't work with a standard Visual Studio 2010 project. And there's no reason why only sf::Time operators would trigger such a linker error.
I'd say there's something wrong in your environment, but it's hard to say what.