Use sf::VertexArray (sf::Lines) version. Generate a lot of such "pluses" (for example, 100x100 pluses)
Then, you can just move it along the view to give illusion of it being "infinite".
When you zoom out too much, just don't draw anything, it wouldn't be seen anyway.