Whilst the existing answer with the original script is perfectly clear in Erik referring to Bruce Banner and Hank Pym I have found the below interview where Feige clearly spells out it is those two.
Feige: What are you remembering?
I think a few shots of the Destroyer and I was talking to [co-producer] Craig Kyle and he was mentioning to me that there might have been a reference to Hank Pym in the movie that might’ve been taken out.
Feige: That scene is in the movie. Literally the only thing we took out were the words “Hank Pym”. It was when Selvig, Darcy, and Jane are on the roof and S.H.I.E.L.D. has just taken all of their stuff. Darcy is complaining about her laptop and Jane is going, “Who the hell are these guys anyway?” Selvig then tells a story, which is clearly alluding to Bruce Banner, that he knew a gamma scientist and this thing happened and S.H.I.E.L.D. came up, which he had never heard of again. Selvig may or may not have all of his facts straight on that, but those are the rumors that go around the science world there. He goes, “I have a friend who has had experiences with these people. Let me email him.” That friend is Hank Pym. But we took out “Hank Pym” because it felt like, “Banner! Hank!” We were just like, “Enough.”
I think that this film is very strong with mentioning other things in the Marvel universe without hitting people over the head with it.
Feige: Well, that reference we felt was one too many times over the head, which is why we pulled it out.
Collider, Exclusive: Marvel’s Kevin Feige Talks THOR, AVENGERS, ANT-MAN, DOCTOR STRANGE, Animated Movies, Reveals What’s in Odin’s Vault (archived)