It appears I left out the .a and .dll files from the lib folder, but I've had to copy those from the sfml1.6, as they weren't supplied in the sfml2 RC, I don't know if this is okay or not.
After that it threw up some really wacky errors:
obj\Debug\test1.o||In function `main':|
C:\Users\aBallofWin\Documents\sfml2\test1.cpp|5|undefined reference to `_imp___ZN2sf12RenderWindowC1ENS_9VideoModeERKSsjRKNS_15ContextSettingsE'|
C:\Users\aBallofWin\Documents\sfml2\test1.cpp|6|undefined reference to `_imp___ZN2sf4Font14getDefaultFontEv'|
C:\Users\aBallofWin\Documents\sfml2\test1.cpp|6|undefined reference to `_imp___ZN2sf6StringC1EPKcRKSt6locale'|
C:\Users\aBallofWin\Documents\sfml2\test1.cpp|6|undefined reference to `_imp___ZN2sf4TextC1ERKNS_6StringERKNS_4FontEj'|
C:\Users\aBallofWin\Documents\sfml2\test1.cpp|14|undefined reference to `_imp___ZN2sf6Window5closeEv'|
C:\Users\aBallofWin\Documents\sfml2\test1.cpp|11|undefined reference to `_imp___ZN2sf6Window9pollEventERNS_5EventE'|
C:\Users\aBallofWin\Documents\sfml2\test1.cpp|17|undefined reference to `_imp___ZN2sf12RenderTarget5clearERKNS_5ColorE'|
C:\Users\aBallofWin\Documents\sfml2\test1.cpp|18|undefined reference to `_imp___ZN2sf12RenderStates7DefaultE'|
C:\Users\aBallofWin\Documents\sfml2\test1.cpp|18|undefined reference to `_imp___ZN2sf12RenderTarget4drawERKNS_8DrawableERKNS_12RenderStatesE'|
C:\Users\aBallofWin\Documents\sfml2\test1.cpp|19|undefined reference to `_imp___ZN2sf6Window7displayEv'|
C:\Users\aBallofWin\Documents\sfml2\test1.cpp|8|undefined reference to `_imp___ZNK2sf6Window6isOpenEv'|
obj\Debug\test1.o||In function `~VertexArray':|
C:\Users\aBallofWin\Documents\SFML-2\include\SFML\Graphics\VertexArray.hpp|46|undefined reference to `_imp___ZTVN2sf11VertexArrayE'|
obj\Debug\test1.o||In function `~Text':|
C:\Users\aBallofWin\Documents\SFML-2\include\SFML\Graphics\Text.hpp|49|undefined reference to `_imp___ZTVN2sf4TextE'|
C:\Users\aBallofWin\Documents\SFML-2\include\SFML\Graphics\Text.hpp|49|undefined reference to `_imp___ZTVN2sf4TextE'|
C:\Users\aBallofWin\Documents\SFML-2\include\SFML\Graphics\Text.hpp|49|undefined reference to `_imp___ZN2sf13TransformableD2Ev'|
C:\Users\aBallofWin\Documents\SFML-2\include\SFML\Graphics\Text.hpp|49|undefined reference to `_imp___ZN2sf13TransformableD2Ev'|
||=== Build finished: 16 errors, 0 warnings ===|
EDIT: I have to leave for a while, but shall be back later!