Technically, Ventress is Count Dooku's apprentice. However, Dooku was Palpatine's apprentice at the time...
A lot of this is covered in The Rule of TwoThe Rule of Two entry on wookiepediaWookieepedia. TL;DR - Palpatine considered it more like what you'd call "guidelines" than an actual rule, really.