Most distros have usable SFML packages. If for whatever reason want to do the work yourself, launch the game in a wrapper script using LD_LIBRARY_PATH=path/to/local/libs and put the shared libraries at that path. This approach is dirty and frowned upon. Static linking, the alternative, is error prone.
Really, why not just rely on the distros' SFML packages?