Polycode gives you more built in stuff(like physics and such) and is more game oriented,
SFML gives you access to the hardware and has some helper classes but essentially leaves all the main coding stuff to you.
I will say tho that las time i spoke to the polyocde guy and mentioned some serious memory leaks he just shrug it off and said,"there fine the OS takes care of any memory leak"