Why doesn't Walter rebuild a window?

Question

I am currently watching the third season, please avoid spoilers beyond the middle of this season (I just watched the flashback episode which make us see Olivia and Peter meet as kids).

Walter tells Broyles something like

"I would like to know what they are up to, what they are thinking..."

He speaks of Walternate and al, of course.

We previously saw the window which allowed him to see the other universe broken. Why doesn't he rebuild it ? It seems like an easy way to spy without the others knowing that they are being spied on.

EDIT : I have now watched the 5 seasons completely.

Spoiler for season 5 :

Walter spontaneously uses the window to check if the Other Side is also invaded by the Observers. So the window is still around and he remembers it.

No rational answer comes to mind for "Why didn't he think of it earlier.". Feel free to try to answer though :)

Answer 1

Walter does not have an easy time remembering things, this is primary on account of brain tissue removed by William Bell.

In the Season 2 episode "Grey Matters"

Walter undergoes a CT scan, and the team learn Walter had three pieces of his brain tissue removed from his Hippocampus which is the primary repository for long term memory.

It is because of this brain surgery that Walter has forgotten most of everything about the other side. It was only after relearning many of these things that he became to get some of his long term memories back, such as the window (and its existence).