There are two things that come to mind.
1 - Are you checking which direction the scroll is? A trackpad can do horizontal and vertical scrolling. SFML tells you which it is in the wheel member of the mousewheelscroll event. Maybe you are getting some horizontal events mixed in.
2 - Are you looking at the delta directly, or storing it in a variable first? For my Surface Pro, the delta from the trackpad scroll is very small, around 0.008 to 0.1 for average scrolling. If you grab it into an int, you won't see anything besides fast (over 1) scrolls.