A long ago read, maybe 1975 approx.; I read this short story in an anthology.
A disease (or space radiation) has wiped out all adults and the oldest survivors are aged about eight. Protagonist has been deep underground and thus survived.
For a while he lives in an American city and is doing some classes to educate the kids. However as they get older some of the bigger ones begin to resent him and he eventually goes into hiding.
He's living down in the sewers where the kids fear to go; he creeps up at night to scavenge for food. There are one or two tense moments where he's hiding in tall grass as packs of pre-pubescent kids roam past.
One night I think he gets distracted (something to do with flipping the glossy pages of a catalogue?) and he is surrounded. He's blazing away with a rifle as they close in on him but it doesn't scare them. They have lived long enough without seeing Westerns or war films to be afraid of a noisy stick, even as some fall the others charge forward and get him.