Roman pagan priests in all their forms could marry, albeit with some rules and regulations for some of them like the Flamen Dialis, but often I think it would not be surprising to find a cult outpost established in some corner of the empire, say perhaps a Mithradic one, where the priests were all males and bachelors.
My bet is that this sort of heavy religious devotion runs back further than Christianity.