The story starts with a man living in modern civilization as we are about to embark and leave the dying world and there are more people on the planet than seats on the fleet leaving for the new home world. For the main character, he was not selected and was left behind by everyone he knew, including his family.
He ended up out on a farm trying to grow food to eat and eventually was able to grow food. People showed up that eventually became his new family/community. They all had to re-learn tried and true methods to sustain themselves without modern infrastructure, such as horses and ploughs etc.
He fell in love with a woman that ended up on the farm and lived out the rest of his life with the end result being grateful he was left behind. (I believe the woman showed up was in average shape but as she worked hard and became fit and lean and an attraction grew between the 2 grew from it... at least that is how I remember how the author wrote it.) The things he now treasured and learned would not had been possible if he left with everyone else and I believe that was the message behind the book.
I want to say the name had "world" in the title and the version I read the book had red letters with a white cover...