In The Two Towers chapter IV "Treebeard" Treebead tells how the Ents and Entwives separated, the Ents wandering deep forests, and the Entwives preferring to live in farm-like communities, way back in the Eldar days.
So the Entwives made gardens to live in. But we Ents kept on wandering, and we only came to their gardens now and then. Then when the Darkness came in the North, the Entwives crossed the Great River, and made new gardens, and tilled new fields, and we saw them more seldom.
Thousands of years later, Treebeard went to see his beloved Fimbrethil again, after years, decades, or perhaps even centuries, and found that the land of the Entwives had been devastated.
I remember it was long ago - in the time of the war between Sauron and the Men of the Sea - desire came on me to see Fimbrethil again.
The war may have been in Second Age 1700 when King Tar-Minastir of Numenor sent a great fleet and army to help the Elves fight Sauron. Or it may have been in Second Age 3261 when King Ar-Pharazon of Numenor sent a great fleet and army to Middle-earth and Sauron surrendered to him. Or it could have been the war in Second Age 3429 to 3441 when The Last Alliance of Elves and Men fought Sauron.
We crossed over Anduin and came to their land; but we found a desert: it was all burned and uprooted, for war had passed over it. But the Entwives were not there. Long we called, and long we searched, and we asked all folk that we met which way the Entwives had gone....But nowhere that we went could we find them. Our sorrow was very great. Yet the wild wood called and we returned to it. For many many years we used to go out now and again to look for the Entwives, walking far and wide and calling them by their beautiful names. But as time passed we went more seldom and wandered less far. And now the Entwives are only a memory for us and our beards are long and grey.
And in The Return of the King "Many Partings" Aragorn suggests to Treebeard that the Ents could search or the Entwives better now that Sauron has been overthrown.
'Yet maybe there is now more hope in your search.' said Aragon 'Lands will lie open to you eastward that have long been closed.'
But Treebeard shook his head and said: 'It is too far to go. And there are too many Men there in these days.'
Clearly Treebeard became less and less of a traveler during the Third Age, and more and more self confined to Fangorn Forest.
And what about the wizards? The Return of the King Appendix B "Tale of the Years: Chronology of the Westlands" The introduction to the Third Age section says:
When maybe a thousand years had passed, and the first shadow had fallen upon Greenwood the Great, the Istari or wizards appeared in Middle-earth.
So the question now is how often and how far Treebeard might still wander from Fangorn after about Third Age 1000, and also how far and in what directions Radagast wandered before and after making his settled home at Rhosgobel over a hundred miles from Fangorn Forest.
Treebeard and Radagast could have met often, and Treebeard might have a well informed opinion about Radagast. Or Treebeard might never have met Radagast and only heard of his reputation. (Celeborn and Galdriel lived closer to Treebeard than Radagast did, and they probably hadn't seen Treebeard since long before Radagast came to Middle-earth.) Or Treebeard might never have heard of Radagast at all - which would make him only slightly more ignorant of Radagast than readers of Tolkien are.
A well informed answer about what Treebeard might have thought about Radagast seems impossible to give since we don't know if Treebeard was well acquainted with Radagast or never even heard of him, and we know too little about Radagast to guess what impression he might have made on Treebeard.