I have to agree with you about hammering on work in the lathe, Alan. I've made the odd dial or two (and one was indeed odd, with 84 divisions) and have knocked up simple MDF jigs to hold the punches.
One dial was small enough to fit in the bench vice on its jig, so I could press the numbers in. If hammering, I find it hard to apply a light thump to 1 and 7, and heavier equal whacks to the other numbers. In the vice I could just turn the handle round to the same place each time to get reasonably consistent depths.
Andy