grizzly 600 swing arm question

Alright, so went to take the old girl out for some work around the yard and after about 30 ft noticed that there was something wrong. So after inspection i found that the bolt on the CVT side of the swing arm had almost fallen out.

I pulled and pushed the quad back into the garage and after looking in the manual i took the shock off then the other side of the swing arm bolt.
I cleaned everything up and replaced one of the oil seals and regreased the bearings and attempted to put it back together and that’s where the problem is…..when i try to get the holes on the swing arm to line up with the frame they are out of an inch and i can’t seem to push the swing arm any closer then what it is.

How do i get it back in place? i don’t want to hammer it in!!!

Can someone PLEASE, PLEASE help me!!!!!!!!!