This sounds very much like Rusty's Space Ship By Evelyn Shipley Lampman, 1957.
Two children, Rusty and Susan, build a play spaceship, which becomes a real spaceship when they get involved with a lizard like alien who visited Earth and now wants to return to his home planet Eopee.
It is mentioned in various previous answers:
Kids' book about boys finding a disc from a planet called "Eyopee"
60's book about a boy who builds a spaceship from cardboard in garage
Children's novel: three children (plus dog?) travel to the Moon in pretend spaceship turned real
My answer to this question about navigation in space wonders whether the alien in Rusty's Space Ship ever found his home: