And try it without dragging your window, as that will make rendering stop working, while the sleep itself still goes on.
Point is, there's no reason why sf::seconds or sf::milliseconds would behave differently, as they both just create an sf::Time object with the given input. As such it sounds a lot like an user error, i.e. you interpreting some behavior wrongly.