From this answer:
if [a mortal] often uses the Ring to make himself invisible, he fades: he becomes in the end invisible permanently, and walks in the twilight under the eye of the dark power that rules the Rings.
So wearing the ring can wear you out.
