Warning: this answer contains spoilers for Doctor Strange in the Multiverse of Madness (2022).
I think it's safe to say that Strange did not see universe 838 while viewing alternate futures in Infinity War, for at least three reasons:
Firstly, the premise of an alternate future is a timeline which has the same history up until the present moment, and then a different future going forward. Whereas universe 838 clearly had a different history extending at least as far back as 1941, when Peggy Carter (rather than Steve Rogers) received the Super Soldier Serum during Project: Rebirth.
Secondly, if Strange had seen universe 838, you'd think he'd recognise individuals like Peggy Carter, Blackagar Boltagon, Reed Richards, and Charles Xavier, which he seemingly didn't when he met them in Multiverse of Madness.
Thirdly, Strange indicated that Thanos was victorious in every one of the 14 million-plus alternate futures he viewed, except for the one he set into motion when he gave Thanos the Time Stone. Whereas in universe 838, Thanos was indicated to have been defeated by the Illuminati, using the Book of Vishanti.
So, for all those reasons, I feel confident in saying that Strange had never seen universe 838, prior to having visited it in Multiverse of Madness.
As to whether or not the alternate futures he saw were universes that actually exist somewhere out there in the multiverse, or just possible branches of the Sacred Timeline which could occur but had not done so yet, I don't think there's any evidence from an official source which can definitively answer that question one way or another. Certainly, none of the movies or TV shows provide a definitive answer to that question, and none of the interviews I've read or seen with the various creators involved do so either.
If you're interested in an educated guess, then I think Strange only saw possible future branches of the Sacred Timeline, not actual universes already in existence somewhere in the multiverse. One of the reasons I think that is that the mechanism he used to view these alternate futures was the Time Stone, which is an object focused specifically on the manipulation of time, rather than the manipulation of space or reality, each of which has its own Infinity Stone. Therefore, as powerful as the Time Stone is, its power is focused along a very specific track, and I don't think it has the capability to breach multiversal barriers on its own.
Also, Strange stated in No Way Home that "the Multiverse is a concept about which we know frighteningly little." Whereas if the Time Stone allows one to view other existing universes within the multiverse, then he and anyone else with access to that object ought to've been able to conduct pretty extensive research on the multiverse if they'd wanted to. It's possible that they had the option to do so and chose not to use it, but given that Strange seemed to be a little scared by how little he knew about the multiverse, you'd think he'd have availed himself of that option, if it were available to him.