In Harry Potter and the Deathly Hallows, while Harry is in Kings Cross he sees something like a small child, which is the fragment of Voldemort's soul that was attached to him.
He recoiled. He had spotted the thing that was making the noise. It had the form of a small, naked child, curled on the ground, its skin raw and rough, flayed-looking, and it lay shuddering under a seat where it had been left, unwanted, stuffed out of sight, struggling for breath.
He was afraid of it. Small and fragile and wounded though it was, he did not want to approach it. Nevertheless he drew slowly nearer, ready to jump back at any moment. Soon he stood near enough to touch it, yet he could not bring himself to do it. He felt like a coward. He ought to comfort it, but it repulsed him.
Harry Potter and The Deathly Hallows
Once Harry returns to the world of the living, that part of Voldemort's soul stays in limbo. Is this what happens to all fragments of someone's soul if he has divided his soul by creating a Horcrux? Does that mean that Voldemort's soul however crippled will stay in limbo or when all parts of his soul die, so does he?