Apparently E. Howard Hunt did talk. His two sons recorded him making (near) deathbed confessions to a conspiracy. E. Howard Hunt's wife discounted them saying the son took advantage of his declining lucidity, but then she would have a motive to protect her husband's legacy given that earlier in life he had denied any involvement under oath before congress, and been involved in a few libel lawsuits.
Does this prove anything? No, it does not, but it does make the contention that, "Somebody would have talked about it," a little more tenuous.