Mr. Adam, a 1946 novel by Pat Frank, better known as the author of Alas, Babylon. The text is available at Faded Page. It's not an all-female world, but there's only one fertile man in the world, and his name is Homer Adam. Does any of these covers ring a bell?
Front cover blurb from a 1948 Pocket Books edition (image below):
Would you like to be the only man in the world who could be a father? Mr. Adam was that man! What happened to him after an atom bomb explosion made every other living male sterile is an extremely funny story.
Wikipedia plot summary:
After a nuclear power plant in Mississippi explodes, it was soon realized that a previously unknown form of radiation was released. The radiation caused all men on Earth to become sterile, even boys who were still inside the mother's womb. However, ten months after the explosion in Mississippi, a doctor delivers a perfectly healthy baby girl. It's soon discovered that the child's father, who has the surname Adam, was more than a mile under the surface of Earth inside an old silver and lead mine during the explosion. It would appear that Mr. Adam is humanity's only hope to stave off extinction.
Review by P. Schuyler Miller in Astounding Science Fiction, May 1948, available at the Internet Archive:
Pat Frank's "Mr. Adam" (Lippincott, $2.50) is by far the best of the three books. It would be entirely at home in such a magazine as Science Fiction if it were not for the conventions which keep honest treatments of sex problems out of "family" periodicals. Briefly, every man in the world except gangling,
carrot-topped, bashful Homer Adam is sterilized by the radiations from an atomic blowup—Adam was in a lead mine at the time. On this one unwilling male rests the responsibility for giving the human race a new start. Mr. Frank misses no
opportunity to carry out the logical possibilities of the political, psychological, and physical free-for-all over this second Adam. He could have written just another dirty book, and would perhaps have sold more copies. Instead he has told a story which can be read as a joyous satire on American bureaucracy—as a somewhat uninhibited development of a standard science fiction theme—or for just plain fun.