Hmm, possibly even simpler - if you're not using a vice at least: Make one of Andy's pointy things, but don't part it off from its shaft. Mount the rigid pointy thing in a collet, bring spindle (NOT rotating) down onto casting so that point enters hole. Unclamp casting from table; allow pointy tool to move casting as you feed in, until the tool is now gently pressing the casting to the table. Lock quill, clamp casting down.
Even if you can't move the casting, you can still use the fixed pointy device, just wiggle the table around until the point snugly fits all around the edge. I might be tempted to add a strong light source in the nose of the point, when you can't see light shining out of any part of the hole, you know you're bob on.