Every time a psyker uses the power of the Warp, he looks into a gaping maw of Hell... and sometimes the Hell looks back! Psykers are not hated because of their power, but because they can, totally accidentally, bring the death and destruction to everyone around. Look at the Dark Heresy Perils of the Warp table - if you have to roll on that table, you are lucky if you die... if you are not, you can doom everyone around you (of course, there are lesser effects - for example, you might start growing a new pair of arms out of your ass, which can be handy to scratch that itchy place on your back).
Now back to the other part of the question: In the 40k universe even not warp-sensitive people can affect reality on a small level. There are dozens of weapons and armours that are better because they've used to belong to someone famous - it is not only because those items were made better for some old hero, but rather because this old hero left some of his/her courage and spirit on his favourite sword. The same rule goes for the Chaos-touched weapons, as it was greatly displayed in the "DOW II - Chaos Rising" videogame, where you could find more powerful weapons, which were unfortunately slowly corrupting your team.
And now, you have with you a skull of someone who has been DIRECTLY touched by Chaos..,.