In Avengers: Endgame, when Hulk/Banner met the Ancient One in order to get the Time Stone, she refused, saying that if one Infinity Stone is removed from a time period, it would cause problems. I recall her saying that the Infinity Stones create the 'stream of reality'.
When Thanos destroyed the Infinity Stones, wouldn't reality have been destroyed?