The issue in Travis-ci comes from SFML which needs libudev.so1 whereas apt-get can only install libudev.so0. I tried symlinking it but it doesn't work. Here is the message :
/usr/bin/ld: warning: libudev.so.1, needed by ../libs/SFML-2.3.2/lib/libsfml-window.so, not found (try using -rpath or -rpath-link)
../libs/SFML-2.3.2/lib/libsfml-window.so: undefined reference to `udev_device_get_action@LIBUDEV_183'
../libs/SFML-2.3.2/lib/libsfml-window.so: undefined reference to `udev_list_entry_get_next@LIBUDEV_183'
[...]
collect2: error: ld returned 1 exit status
make[2]: *** [runner] Error 1
make[1]: *** [CMakeFiles/runner.dir/all] Error 2
make: *** [all] Error 2