You don't know 100% what's at the other end of the pipe (big/little endian), but everyone agrees that data on the wire is big endian - so everyone can interoperate.
I have a DEC Alpha running Debian Linux that may be very cross if you start assuming that it is little endian and should expect that on the network. Also, little endian machines *know* that everything coming in is big endian and will convert - if it is suddenly little coming in, that conversion will be wrong, at the very least you have backwards compatibility issues with previous sfml versions.
Better to just let the network stay BE as it always has and get fewer headaches. The performance hit is negligible anyway.
(And how on earth did that fscked-up LE byteorder get the upper hand anyway? That's just wrong - BE is the natural thing and the way to go - but I give up...)