One situation came into my mind: That one scene in the first (new) movie where he lets (the future) Sandman escape due to not receiving his money. Although he didn't talk the exact second Ben is attacked.