Only the Idaho ghola from Heretics Of Dune & Chapterhouse Dune is explicitly stated to have the memories of his original pre-ghola life and the memories of any of his ghola lives. As it happens, he has the memories of all his ghola lives. None of the previous gholas are stated to have had anything other than the memories of their original pre-ghola life . . . except . . .
The problem with the main ghola in God Emperor Of Dune is that he appears to have both the memories of his original pre-ghola life and those of his first ghola incarnation (Hayt, from Dune Messiah & Children Of Dune). This is somewhat of a continuity-snarl because it seems to break some of the in-universe rules about ghola memory retrieval as established by that point in the saga, and in retrospect with reference to the Heretics/Chapterhouse ghola.
Herbert never explicitly states that gholas can't retrieve the memories of their previous ghola lives in any of the books up to & including God Emperor, but this seems to be the case by virtue of the fact that the Heretics/Chapterhouse ghola is stated to be the first to do so.
Therefore, in retrospect it seems that in God Emperor Herbert is retroactively breaking or contradicting a rule he would later set, or is implying but not stating that for some reason all serial gholas can have their original pre-ghola memories and the memories of their first ghola incarnation restored, but not the memories of any ghola lives after their first revivification (at least, at this point in the saga). The other option is that Herbert was careless with the handling of established continuity from his own books, and the apparent possession of Hayt's memories by the God Emperor ghola is a mistake.
It is stated in Chapterhouse that the ghola in that book was grown using cells from most (but not all) of the previous serial gholas as well as the original pre-ghola, which implies that the God Emperor ghola could legitimately have the memories of his original pre-ghola life and the memories of Hayt if his body was grown using cells from both.
This seems to be the neatest in-universe solution, but then the question becomes: why not incorporate cells from all of the intervening gholas as well?
Note that the main ghola in God Emperor has no memory of his immediate predecessor's life, as witnessed by his shock at meeting his predecessor's wife and child in the village that Nayla & Siona take him to.
I personally think that the apparent possession of Hayt's memories by the God Emperor ghola is a (retrospective) mistake by Herbert.