There’s more than one Dark Dimension in the multiverse.
surely, in an infinite multiverse, there will be at least one, if not an infinite number of dimensions/universes in which everything is almost exactly the same, with only small differences, for example the sky is a slightly different colour
Maybe, maybe not. We have a limited understanding of the rules the MCU multiverse operates under, and I'm sure the writers don't want to invent them until they come to actually write stories that depend on them.
One such story that features "the" Dark Dimension is What If... Doctor Strange Lost His Heart Instead of His Hands? This features an alternate universe, where Doctor Strange does some... inadvisable things with the Time Stone. We see the Doctor Strange of this universe confront and defeat Dormammu in the Dark Dimension, much as our Doctor Strange did in his movie.
As such, presumably both the regular MCU, and the alternate universe portrayed in this episode, each have their own version of the Dark Dimension, as we didn't see two Doctors Strange in there bargaining Dormammu right in his big ugly face.