Clearly, he speaks English not very well.
So he must speak another language natively. Which one?
We don't know much about Yoda's species mostly because "George Lucas maintains a strict policy of keeping the history, name, origin, and whereabouts of this species secret". This is also the case for his native language.