Yuck!! When I find things like this the first thing I'll try is using a bushing or socket I'll try to smash it or press it out, but you removed the rounded over parts so I think you'll just get that stuck in there to. Sounds like penetrating oil won't do much but can't hurt either. Heat from a torch will damage the strength of the housing but a heat gun should be ok. Then I would get a .250 punch - something that won't bend and sharpen the face of it to make it square. As soon as you hit it and it misses it will round the end of the punch off again and you must sharpen it again continuing to try to get the race to pull away or curl etc. . I would sharpen another punch to a point and try to get it between the aluminum and the outer race which is stuck. Careful as any damage to the soft aluminum will hurt the fit of the new needle bearings. Someone here must have a swing arm if all else fails. This is usually about the time I curse the person I bought the machine from for letting water destroy it.
Good luck
All our government does is distract us while they steal from us, misspend our tax $ and ruin our country