Starter motor needs to be shimmed to the correct distance and the bolts replaced. You banging on the starter motor knocked it out of alignment. If you had been using starter motor bolts (with knurled shoulders) it should not have moved at all which is why I think you have regular cap screws instead of a dedicated starter bolt.
Adjusting a starter; you can use a medium paper clip as a gage wire:
Brass Starter Motor Shims are sold by Mr. Gasket:
Starter Bolts are different!
The knurled section fits tight within the block as the bolts press themselves into the softer cast iron:
Big Dave
Adjusting a starter; you can use a medium paper clip as a gage wire:

Brass Starter Motor Shims are sold by Mr. Gasket:

Starter Bolts are different!

The knurled section fits tight within the block as the bolts press themselves into the softer cast iron:

Big Dave