Following the logics of the film, there is no time distortion other then those experienced by both Brand and Cooper (on Millers and during the slingshot). The direct fall into the black hole by Cooper alone is not supposed to cause additional time loss in the film - you see that quite clearly when you listen to the dialogue between Romilly and Cooper on Manns planet: the plan to send TARS inside so that he can collect the data and try to figure out a way for transmitting the data is developped while they prepare for transport of camp and colony cargo down to Manns so that Cooper can leave on his journey home. The film does that by defining the hole as a "gentle" one - rotating in a way that something (TARS) crossing the horizon fast enough can survive that, so in the film the idea of crossing fast enough makes the difference - the slingshot in Gargantuans gravitational pull causes time distortion, a direct fast fall not. Otherwise sending TARS inside would be useless as getting the data millions or thousands or even hundreds of years (or even just further decades) later would be too late.
"They" (i.e. future "we") therefore do not transport Copper through time at the end, after closing the tesseract, just through space. Distortions inside the worm hole on his way back obviously cause a small time glitch which allows for the "handshake", but that's it, they don't choose a time for him to be found, just the space (near Saturn, where the space station is orbiting). Communication with the past via gravity was done inside of the tesseract, but this is communication only - he can "talk" with the past, not make himself a part of it - the entire sequence fall-tesseract-arrival at Saturn is written as one same time line, in which time passes for Cooper exactly as for Earth/Cooper station and as for Brand.
So, at the end, time is not additionally distorted, hours pass - those hours of oxygen that Cooper had in his space suit when he ejected from the shuttle inside the hole, he is found with minutes of oxygen left, that's the time that passed. When Cooper is found, Brand is still on her way to Edmunds planet. Murph was expected on the station "in a few weeks", in those few weeks (up to the talk between Cooper and Murph) Brand arrived on Edmunds planet, buried Edmunds, started to build the Camp up. So: exactly the same time has passed for both of them. Cooper will need a few weeks only to arrive on Endmunds planet (the space station orbits Saturn, so he is just nearby the worm hole, he does not have to travel additional 2 years this time and behind the hole is't a few weeks journey, that's all).