In the Star Trek: The Next Generation episode Force of Nature, we find that warp drive damages space and that one area of space is more unstable than others. But not only are all galaxies rushing out from the center of the Universe, but the Milky Way rotates.
In one year, when the Earth returns to where we are in orbit, Earth will still not occupy the same point in space because Sol will have moved around the core of the galaxy in a large orbit and the entire Milky Way has moved farther away from the center of the Universe (supposedly the source of the Big Bang). So how can warp drive "wear down" any area of space or have an impact on space that will still be near us much longer?