Ideally, yes. They should.
But one of the issue of extreme morality like these is that deep down, everyone crave basic human desires. Reproduction/sexuality being one of them, and priests usually have oaths to fulfill.
And when you suppress these craving for too long, I believe they turn into weird, dark and repressed fantasies. Priests grooming children is one of them.
If you don’t care about people’s views, why should I care about yours?