Yes, they're born with a sinful nature but until they know that sin is wrong, they aren't accountable. I don't know the age of accountability. I suppose it varies with different children.
It does vary. The Catholic Church traditionally teaches, as a rule of thumb, that the age of reason is attained at 7 and recommends the first confession and first communion at about that age, generally.