You're right, it's by Niven. It's called "Like Banquo's Ghost", referring to how the alien is the proverbial ghost at the feast.

http://www.isfdb.org/cgi-bin/title.cgi?54289