Well, I am traveling forward in time in home made Time Machine with the speed of one second per second. I do not see any problem you are describing. Now I just need to add the reverse, but I do not expect any issues of this kind either.
A "sit on earth and watch things happen in reverse", like the movie The Time Machine?
(I always wondered what everyone else thought of that.) Or was there another thought?