In the TV show there's a baby taken and converted a few minutes later. I assume they then grow into adult walkersWhite Walkers. Unless the white walkerWhite Walker babies have freezing diarrhea squirt powers that get revealed in the next book, in which case they may just keep them as weaponized white walkerWhite Walker infantry.