With himself
By then Saruman wants the Ring for himself, and hopes that leaving Sauron alone for a bit might help the Ring re-surface. He is not in any way in league with Sauron yet, as he has not started using the Palantir. (Note that he was never truly Sauron's servant, his plan A was to get the Ring for himself and plan B to survive by allying Sauron rather than to die opposing him)
Also note that in the books, there is actually much more time (90 years) between the moment Saruman refuses an attack on the Necromancer and the time it happens, because in between Saruman becomes afraid of Sauron's ability to recover the Ring by himself from Dol Guldur.
Relevant quotes gotten from this answer to a related question :
2851 The White Council meets. Gandalf urges an attack on Dol Guldur. Saruman overrules him (footnote: It afterwards became clear that Saruman had then begun to desire to possess the One Ring himself, and hoped that it might reveal itself, seeking its master, if Sauron were let be for a time.). Saruman begins to search near the Gladden Fields.
2941 Thorin Oakenshield and Gandalf visit Bilbo in the Shire. Bilbo meets Sméagol-Gollum and finds the Ring. The White Council meets; Saruman agrees to an attack on Dol Guldur, since he now wishes to prevent Sauron from searching the River. Sauron having made his plans abandons Dol Guldur. The Battle of the Five Armies in Dale. Death of Thorin II. Bard of Esgaroth slays Smaug. Dáin of the Iron Hills becomes King under the Mountain (Dáin II).
c. 3000 The shadow of Mordor lengthens. Saruman dares to use the palantír of Orthanc, but becomes ensnared by Sauron, who has the Ithil Stone. He becomes a traitor to the Council. His spies report that the Shire is being closely guarded by the Rangers.
-- Lord of the Rings, Appendix B "The Tale of Years", The Third Age