I've tested this when I switched to Qt5, and yes this is really a significant improvement.
You should create a task in the tracker, so that I can schedule it for a future revision. If we can keep the old setup in parallel to the new one then it can be added soon, in a future minor revision; if we have to break compatibility then it will have to wait for SFML 3.