In the first season of Babylon 5, there is an episode called Legacies. In this episode, Sinclair gets into a physical altercation with a Minbari, Neroon, in his quarters. Not just any Minbari, but one of the leaders of their warrior caste. This should be one of the most formidable warriors of their entire species.
Sinclair beats him without too much difficulty, apparently by being significantly stronger. He basically just punches him and throws him across the room.
Later, in the season three episode Ceremonies of Light and Dark, Lennier picks Marcus up off the floor with one outstretched arm and holds him there without any apparent effort. This is quite a feat of strength, and in context it is clearly meant to intimidate Marcus. Lennier reminds him that "sometimes we may look like you, but we are not you" (quote from memory may not be exact).
This implied that Minbari were so much stronger than humans that Marcus, a great fighter capable of single-handedly beating an entire room of humans in hand-to-hand combat, should not even consider fighting Lennier.
That episode also includes some human Night Watch members taking Delenn and another Minbari hostage. At no point does it seem like either Minbari is particularly powerful.
These examples seem contradictory, and it's not enough data to form a conclusion. Perhaps one or both of Lennier and Sinclair are simply exceptionally strong for a member of their race.
So, are Minbari physically stronger than humans, or not? If so, how much? Is it an overlap, like men being stronger than women on average, or is the weakest able Minbari still stronger than the strongest able human?
Note: I'm re-watching the series. I've seen the whole thing before, and am not concerned about spoilers in the answers.