Ah. Yup, there is (and related headers).
For future forumgoers (or probably me on my next project when I forget how I did this), you also need to link opengl32.lib. (it has the headers, but not the lib with the rest). Additionally, if you are on windows, also link winmm.lib.
(solved)