There's not that much specific stuff to macOS that you need to know to make it work from the command line for basic application. It become slightly more involved if you want to create an application bundle, especially if you want to sign it, but you can find some tutorial for that, I'm sure.
Installing SFML is the same: follow the instruction at the beginning of the Xcode tutorial.
Compiling & linking your command line application is done the usual *NIX way: just `man clang` and so on to learn how. One important difference for linking though: -framework vs -l (lower case ell) (RTFM, ofc).
@Turbine: Staying away from IDE and instead use Makefile (or some similar technology) has the advantage that your project will still compile in 5+ years. Some Xcode projects can no longer be "upgraded" from old Xcode versions to newer ones. Also, vim is great!
Side note: clang is now the default compiler for the C language family.