Very late response and I hope you still lurk here to read my response.
But yes its one of the downfall of the Roman Empire but paradoxically one of the reasons the Roman Empire survived so long. A great introductory book is The True Believer by Eric Hoffer. Its not specifically on the Roman Empire but he does note some universal factors that led to the downfall of civilizations among which he quotes events in the Roman Empire.
I'll try to look for quotes. But I hope you are here to see my post. Go read The True Believer and you will see how much education and the elitist intellectuals both destroyed and ensured the survival of the Roman Empire.