The Middle-earth lies amidst the World, and is made of land and water; and its surface is the centre of the world from the confines of the upper Vaiya to the confines of the nether. Of old its fashion was thus. It was highest in the middle, and fell away on either side into vast valleys, but rose again in the East and West and again fell away to the chasm at its edges.
And the two valleys were filled with the primeval water, and the shores of these ancient seas were in the West the western highlands and the edge of the great land, and in the East the eastern highlands and the edge of the great land upon the other side. But at the North and South it did not fall away, and one could go by land from the uttermost South and the chasm of Ilmen to the uttermost North and the chasm of Ilmen.
The History of Middle-earth Volume 4, The Shaping of Middle-earth, The Ambarkanta, p. 238
Then the Valar removed into the West and forsook the island; and upon the highland at the western side of the West Sea they piled great mountains, and behind them made the land of Valinor. [...]
For their further protection the Valar thrust away Middle-earth at the centre and crowded it eastward, so that it was bended, and the great sea of the West is very wide in the middle, the widest of all waters of the Earth. [...]
The History of Middle-earth Volume 4, The Shaping of Middle-earth, The Ambarkanta, pp. 238-239
And the thrusting aside of the land caused also mountains to appear in four ranges, two in the Northland, and two in the Southland; and those in the North were the Blue Mountains in the West side, and the Red Mountains in the East side; and in the South were the Grey Mountains and the Yellow.
The History of Middle-earth Volume 4, The Shaping of Middle-earth, The Ambarkanta, pp. 238-239