It would only make sense that, as the empire grew, the army began to include members of conquered races.
I think that a bigger problem was likely the breakdown of the leadership of Rome as a whole- leading to less effective management and leadership of the legions and therefore allowing for a weakening of defense and inevitable breakdown of the legions and eventually, the empire.