Solved it but don't know why. For the next poor sucker who's stuck up late at night 4 pages deep on google looking for a solution, it's a mismatch between static sfml libraries and dynamic runtime library. I changed my linker settings for by debug build to be sfml-network-d.lib instead of sfml-network.lib and it seems to be working fine now.