The viewing audience at least isn't aware of predecessors until the Architect mentions it. When Neo mentioned it to Morpheus he believed so much in the One that he didn't believe Neo wasn't the first One.
So my question is, why didn't Neo ask who he was talking about? Did Neo think he was rambling nonsense to throw Neo off? Or did Neo think they were failed Ones?