Hi,
I am experiencing the exact same problem here and it looks like it comes from the Joystick event processing.
Commenting ProcessJoystickEvents(); from WindowImpl.cpp seems to "fix" the problem and also drastically improves the framerate.
Unfortunately I'm not knowledgeable enough to investigate the issue further.
SFML2 from github
VS 2010
SFML_STATIC
Win7 x86