It's not clear which city she is mentioning, but it's presumably Gotham or Star City.
Pretty much all of the DC shows airing alongside Supergirl make stealth references to other DC properties that they can't normally talk about (e.g. Legends of Tomorrow had Rip Hunter say that he'd seen "Men of Steel die and Dark Knights fall"). This is in a similar vein.
Argument for Star City
Greg Berlanti and Andrew Kreisberg are showrunners for both Arrow and Supergirl (with Kreisberg also being showrunner for The Flash). Because there is contradicting evidence (see below) it could have just been a reference made to those shows before it was decided to have a crossover with Flash and establish that it was in a different universe.
Argument against Star City
Four episodes later, there was a crossover with the Flash, which established that Supergirl was not in the Arrowverse at the time (now that the show has moved to The CW, it is in the Arrowverse and will have crossovers with those shows). Since Supergirl didn't know any of the names of superheroes that Barry mentioned (including Green Arrow), that makes it less likely that on her Earth, there is an equivalent to Green Arrow and the other masked vigilantes.
Argument for Gotham
The fact that they have to indirectly talk about the city makes sense for Gotham, since it's currently tied up with the movies. But it would be strange if it were some other city that they can talk about (e.g. Coast City, which they have mentioned by name).
Gotham is another DC city where there are lots of masked characters (i.e. Batman, Robin, and the majority of his rogue's gallery). It's also currently featured in the show Gotham, which is currently airing right now. No other city in the DC universe have a high number of DC heroes or villains who wear masks, so it's the most likely candidate.