In the book "The Emperor Of Mankind" this is actually expanded upon in a flashback with the Emperor and a Tech Priest of Mars. I can't find the actual quote, but even the Emperor concedes that they cannot be removed without killing Angron and he is of the opinion that an Angry Angron is better than no Angron