If you're looking for more toughness than mild steel can offer, I'd suggest 4140HT. Unless you plan on hardening, which is not recommended for a tool arbour, there isn't much point to using silver (tool) steel.
That said, mild steel would likely serve you just fine without any trouble.