tl;dr
What do the others think?
I fully agree on every single line. Jesus, this is rare, but I really agree to what you said.
However, whilst SFML in itself is greatly designed, it's not best suited for writing extensions in some areas. I guess the reason for that is the simplicity this library was and still is targeted at. E.g. you never have to instantiate a renderer and you mostly don't have to deal with technical details. SFML is, even if often stated otherwise, quite high-level with not sooo much room to be extensible -- at least not without touching the original code.
I, and most likely others, including binary1248, too, would have written some extensions for SFML already if it was easy or even possible to do so. Just like this z ordering discussion. The problem is that I can't really do it myself without patching SFML, while having in mind that my patch probably will never be accepted because the library's author has another philosophy.
Like binary1248 I'm also convinced that SFML could be a lot better regarding acceptance in the "more serious" field by enabling the user to use or attach advanced features and techniques. But without that possibility I assume that many won't consider using SFML for projects because of its limited scope. I already said it a million times already, but I'm seriously considering writing my own OpenGL rendering code (again *sigh*) for the _small_ game I'm making because I've already hit the boundaries of SFML that I can't workaround without patching it.
Of course making SFML's modules more exchangeable isn't a step you can do in some days or even weeks, and something like this has to be planned carefully. But if you asked me, I'd love to see SFML's future in a collection of core and extension modules. One might argue that SFML already is just that, but that's not quite true. Even if the modules are separated, and if some of them can be dropped if not used/needed, they still form a whole in themselves.
So, +1 for an SFML App Store.