I read a short story a long time ago and I can neither remember the title nor the author. The main character is a musician. He is sequestered and allowed to play all day on some kind of a fantastic instrument; however, he has been barred from listening to any music for fear that it will stifle with his innate creativity. Someone secretes him some Bach, he listens to it, and is then caught and cast out. He gets a series of jobs and is inevitably punished for breaking some music-related taboo.
Any ideas?