I'm pretty happy with my Enco Mill Drill, and I have mostly used it for milling, not drilling.
There have been many mods of these machines published over the years to deal with the fact that the head swivels (which is intentional). That doesn't happen a lot of the time, only when you have to raise or lower it MORE than the 6" that the fine feed provides. Usually you don't while milling since end mills are generally about the same length. It's when switching between milling and drilling where you're adding a drill chuck plus drill that you might have to raise the head.
One interesting solution involves attaching a cheap laser level to the head and marking a vertical line opposite on the wall of the shop. Then you line up the laser dot with the line to bring the head into alignment after raising it. There are other solutions, like pinning the rack (normally it swivels with the head) and using a shim or gib, etc.
As said above it all depends on what you have to spend, and how much work you want to do to modify things to suit your own needs. I don't have any plans to get rid of mine, although if someone wanted to trade a Bridgeport for it, in equivalent condition, I wouldn't say no.