In season 5,
There is a cat and mouse game between the observers and the fugitives (main characters), where the fugitives repeatedly escape just in time.
In some cases the observers even catch a glimpse of the fugitives taking off.
When this happens, why dont the observers just go back in time for a minute or 10?