There's no such thing as "magical realm". All Harry Potter magic world is exactly in the same Earth as the Muggle world, but just hidden by charms of protection and concealment.
For example, the Leaky Cauldron is out there in London at plain sight... If you're a mage. Muggles simply don't see it.
The people hurrying by didn’t glance at it. Their eyes slid from the big book shop on one side to the record shop on the other as if they couldn’t see the Leaky Cauldron at all. In fact, Harry had the most peculiar feeling that only he and Hagrid could see it.
Harry Potter and the Philosopher's Stone. Chapter Five: Diagon Alley.
We can assume that the Burrow has some sort of Muggle repellents and/or concealment charms, just like Hogwarts, to avoid Muggle neighbors intruding and discovering magic. That said, I don't recall a canon source where it is explicitly stated.