The Valar are revered, but not worshipped
In fact there's very little worship among elves at all. This is discussed somewhat in Letter 153; Tolkien likens the relationship to a Catholic calling on a saint:
There are thus no temples or 'churches' or fanes in this 'world' among 'good' peoples. They had little or no 'religion' in the sense of worship. For help they may call on a Vala (as Elbereth), as a Catholic might on a Saint, though no doubt knowing in theory as well as he that the power of the Vala was limited and derivative. But this is a 'primitive age': and these folk may be said to view the Valar as children view their parents or immediate adult superiors, and though they know they are subjects of the King he does not live in their country nor have there any dwelling.
The Letters of J.R.R. Tolkien 153: To Peter Hastings (draft). September 1954
Earlier in the letter, he again remarks that the Valar are to be revered, not worshipped:
The immediate 'authorities' are the Valar (the Powers or Authorities): the 'gods'. But they are only created spirits – of high angelic order we should say, with their attendant lesser angels – reverend, therefore, but not worshipful
The Letters of J.R.R. Tolkien 153: To Peter Hastings (draft). September 1954
That being said, it's not impossible that certain elvish sects, like the Avari, did practice worship of the Valar; but so little is written about them that we can't say for certain.