We CAN know that Jesus didn't, but can anyone say the same about the Apostles? Well, let's see what some early church fathers mentioned:
From http://www.newadvent.org/fathers/250103.htm, Eusebius of Caesarea's Church History talks a bit about this:
Clement, indeed, whose words we have just quoted, after the above-mentioned facts gives a statement, on account of those who rejected marriage, of the apostles that had wives. Or will they, says he, reject even the apostles? For Peter and Philip begot children; and Philip also gave his daughters in marriage. And Paul does not hesitate, in one of his epistles, to greet his wife, whom he did not take about with him, that he might not be inconvenienced in his ministry.
That Philip the apostle dwelt at Hierapolis with his daughters has been already stated. But it must be noted here that Papias, their contemporary, says that he heard a wonderful tale from the daughters of Philip.
Clement, indeed, whose words we have just quoted, after the above-mentioned facts gives a statement, on account of those who rejected marriage, of the apostles that had wives. "Or will they," says he, "reject even the apostles? For Peter and Philip begot children; and Philip also gave his daughters in marriage. And Paul does not hesitate, in one of his epistles, to greet his wife, whom he did not take about with him, that he might not be inconvenienced in his ministry."
That’s not sola scriptura, is it?