During the Pilot episode, as they evacuate the base you can see a number of crates and boxes of supplies come through the gate behind them.
I think we can assume that these boxes contain your mystery shaver and various other fripperies such as food.
This is backed up by the episode's official novelisation (which was itself based on the show script)
Young didn’t press the point and turned back to the lieutenant. Make sure that everyone carries as much of the expedition supplies as they can.
Scott gave him a questioning look. Why?
You’re not going to Earth. Rush dialed the ninth chevron.
and
Young saw the chaos at the mouth of the gate and shouted at the top of his lungs, snarling at the evacuees to get through as quickly as they could. The gate room and Icarus itself was coming apart as chunks of concrete and rebar fell from the ceiling, smashing through gantries where they landed. Control panels sparked and dimmed as power began to die off through the base’s crippled systems, and the colonel knew that the death knell was only seconds away.
Greer was almost at the event horizon, supporting an injured civilian with his free hand. He caught sight of his commander and called out. Sir!
Young stabbed a finger toward the Stargate. Go! he shouted, and reluctantly the Marine obeyed.
Dozens of supply cases and backpacks were scattered across the floor, left behind by the fleeing evacuees, some too heavy to carry, others broken open with their contents scattered. He looked up to see the last few people passing through the gate, and Young halted, instead turning to the crates and starting a frantic search.