Those would be good optimizations, but I see no real performance decrease (on release, /02) unless changing fonts about 100 times per second. Even with multiple fonts, the memory only rises depending on the amount of text and whether it's changing, but does not exceed 2 GB in the most extreme cases with multiple fonts. I still get a steady 500fps when changing font size every frame.
Overall I think there's not much need for optimization other than maybe increasing the max cache size a bit. The way I see it, if there's a fix in place and there's performance issues, it's a user flaw. But if there's no fix at all and memory leaks persist, it's an SFML flaw.