You're right, it's by Niven. It's called "Like Banquo's GhostLike Banquo's Ghost", referring to how the alien is the proverbial ghost at the feast.
Your summary is spot-on, it was probably just hard to locate the story because of the Shakespearian title.