There are several serious contenders mentioned in the EU novels.
Fleet Admiral Akaar (a Capellan) is 2.5 metres tall. Apparently his height was not atypical of his race.
And the third person towered over everybody. Fleet Admiral Leonard
Akaar, who had been the Starfleet liaison to the president since
Admiral Ross’s retirement last year, was from Capella IV, where they
bred them big. The admiral—who had passed his centennial birthday—was
two and a half meters tall, with long white hair and the face of a man
who had pretty much seen everything.
ST: A Singular Destiny
One of the Briamosite delegates is approximately 2.5 metres tall.
"This is Sarvus, Leader of all the Briamosite systems, final arbiter
of multiple-world decisions." Pliver introduced them to the elegantly
appointed, two-and-one-half-meter-tall Briamosite who had stifled his
laughter at Uhura-kirk's comment. "And Vice-Leader Chellea," Pliver
continued, indicating the tallest member of the naturally towering
alien delegation.
TAS: The Slaver Weapon - Official Novelisation)
Although the novel doesn't end with an explicit agreement on a treaty between Briamos and the Federation to join, that was the purpose of the visit, which ultimately ended with a big thumbs up from the Briamosite delegation. Additionally their planet and its surroundings are seen in the Star Trek: Star Charts factbook in solid blue, strongly indicating Federation membership.
As to the tallest member seen on screen, that's probably a tie-in between the Arkenites at 2.2 metres
and the Klingons (yes, I know) at 2.3 meters.