you all keep saying that, but its not really true
It still holds true. It does not only matter what people build with SFML, but what its creators defined as its scope. The scope does not imply game-specific components.
If at all, a game module would be imaginable. But that'd most likely lead to a fully fledged game engine, which is just not within SFML's scope. We have to cut it somewhere.