In this episode there are " Time People" who move in a slightly different dimension. We see them as a slow moving blur....they hide your keys, move stuff so you can't find it, and love to cause gremlin like disruption in people's homes. My family always blamed the " Time People" when ever we couldn't find something. I'd guess it was around 1981. I've searched all twilight zone, outer limits, amazing stories, but can't find anything about this! I'd really like to find it. It was really creepy too! Thanks!
There is a Twilight Zone Episode (from the somewhat obscure 1985 remake) that contains elements of your question. Though I do not remember the term "Time People" they do reference losing keys, time travel and strange, faceless workers that might be mistaken for gremlins. Not holding out a lot of hope this is the answer, but the link goes to the relevant scene.