Until someone comes along with a better answer based explicitly on Tolkien's writing, I will simply suggest the link to the Norse MidgardMidgard.
Remember that Tolkien drew a lot of inspiration from Nordic sagas and myths, and Midgard is the Nordic name for the world of men, the one that stands in the middle of Yggdrasil the world tree. There are worlds below it and above it, ones inhabited by gods or giants, but this is the middle one, mainly because it was myths by humans and for humans.