The staff is a magic weapon from Asgard and the crystal he uses is different from the gems from the infinity gauntlet. It is the mind gem, not part of the tesseract.