When Thor was stripped of his power in Thor (2011), he was reduced to human level strength and durability, as he acknowledges when he tells Sif, Volstagg, Fandral and Hogun that he's "just a man", explaining why he'd be more of a hindrance than a help if he attempted to fight the Destroyer alongside them.
This is also evidenced by the fact that one, physically large S.H.I.E.L.D. agent was able to give him a decent fight at one point, as well the fact that he was mortally wounded by a single blow from the Destroyer, whereas Volstagg took a similar blow, and was stunned but not seriously injured.
THOR: Jane, you have to leave.
JANE FOSTER: What are you gonna do?
THOR: I'm staying here.
VOLSTAGG: Thor's going to fight with us!
THOR: My friends, I'm just a man. I'll only be in the way, or worse, get one of you killed. But I can help get these people to safety.
Thor (2011)
Regular Asgardians are all superhumanly strong as far as we know. Sif, for example, was able send an RV sliding several metres along a road by shoving it with one foot, in the Agents of S.H.I.E.L.D. episode, "Yes Men".
And another Asgardian going by the name of "Elliot Randolph" was able to catch the blade of a knife thrust toward him by Agent Ward, and crumple it in his bare hand, with no visible pain or injury, in the Agents of S.H.I.E.L.D. episode, "The Well".