Caseys crime was not that he had sex with a consenting Adult!
Or that he fathered a child.
His crime was that he stole from parish funds to hide his secret.
He was used to the good life and enjoyed his power and popularity.
He could never have given that up!
That said he was a loss when he left the country. He did a lot of good things during his ministry.
The Late Late Show clip (above) shows you how the country Ganged up on the Yank. Uncle Gaybo being the ring leader!