You can add a increasing taxation situation, inflation, and heavy reliance upon slave-labor to accomplish public projects. Some historians will even say by the early 300s...the empire was sinking.
Add continual debasement of their coinage by reducing precious metal content.