Yes, it appears with scaling and rotation too. And there's no general solution.
But this is actually a desired effect: move, rotate or scale slowly your sprite, and you'll see a nice smooth movement. If the interpolation that you now see as an issue was not performed, the movement would be jerky. So this is great for movement but indeed a problem with static entites. The only workaround is to ensure pixel-perfect rasterization by controlling all the transformations involved in the rasterization process.