According to Wheel of Time wiki (don't click that, spoilers abound), 3% of the population in the Age of Legends could channel. 3% of the male population of an advanced world-spanning utopian civilization were male channelers. I'd guess they numbered at least in the millions.
So, you have millions of male channelers. Every single one of them went insane, often in a murder-and-destroy manner, and even the weak ones could do things like throw a handful of fire at someone. The strongest ones could wreak destruction on par with the detonation of an atomic bomb, and they could do so repeatedly and in many different ways, limited only by fatigue until they died - and they were very hard to kill and had lifespans measured in centuries.
In a very short period of time the entire world became a chaotic war-torn mess where you never knew when the next personified roving unnatural disaster zone might show up, or when your teenage brother might discover he can channel and be faced with the choice of suiciding or becoming another personified roving unnatural disaster zone - he might manage to hold off the madness for a few years if he were lucky, but no one could hold it off forever.
Global society disintegrated, and practically the entire world population became refugees with nowhere that could shelter them. By the time enough of the older male channelers had died off and coping strategies for the new ones had formed, centuries had passed, and a map from before the Breaking would be completely useless - even the land, even on the scale of mountains and continents, no longer bore any meaningful resemblance to what it had been before, because of how much tinkering with the landscape all those insane men had done over all that time.