An immortal and very old man resides in a mausoleum. He is the last man on Earth. He hears a great noise, goes outside and is disappointed, it was only a starship decelerating in the atmosphere. The aliens land and attempt to interview the man using a translator. He amuses himself by changing languages many times during the interview until he is caught. The aliens leave after determining that the man believes everyone died of 'Peace' and that he had refused this peace and had been condemned to immortality.
I last read this over twenty years ago, but it was probably from the golden age, possibly from Galaxy or Amazing Stories.
I have just read "Forever" by Damon Knight (1981), this is a very short story and nothing like the one I am seeking.
Sorry for the delay but no it is NOT 'Forever' by Damon Knight.
One extra item, one of the aliens responsible for recording the interaction with the 'Last Man' uses a key word for the files calling them 'Beetles & Birchbark' or something similar.
Update: I think the Aliens were Humanoid, the Interview team consisted of a Male and Female. The rest of the crew were mentioned as investigating the Crypts and when they started drilling holes in things, the old Man chased them out of the mausoleum.
Update: It is NOT contained within the 'The Last Man on Earth' anthology by Isaac Asimov.