I just watched "Time Heist" (S08E05), and I don't understand why the Doctor and his team needed to wipe their memories ?

He prepared all this

to free the second Teller

So

The first Teller could have read their thoughts and just let them do/help them ?

Why would he do that ?