The Catohlic Church says that they are innocent of personal sin but carry the Original Sin. The Orthodox would also say that the children are innocent of the personal sin, but they would qualify the condition they inherit from Adam differently and not call it sin.
Yes, they're born with a sinful nature but until they know that sin is wrong, they aren't accountable. I don't know the age of accountability. I suppose it varies with different children.