When Sauron forged the one ringOne Ring and put it on his finger, the other ring bearers were immediately aware of him and his intentions and removed their own rings. There is no reason why they couldn't merely do so again.
As soon as Sauron set the One Ring upon his finger they were aware of him; him; and they knew him, and preceivedperceived that he would be master of them, and and of all they wrought. Then in anger and fear they took off their rings rings.
"Of the Rings of Power and the Third Age," The Silmarillion
"Of the Rings of Power and the Third Age," Silmarillion