Since we never hear that his father's clothes were dumped on the high school's general office counter by his mom, maybe that story's not true.
And the rumor that his dad had to live at the school back then, and kept his toothbrush in the custodian's closet, isn't publicized.
Maybe it isn't true, either.
If any of this is true, someone should RE-warn the Baldwin boys that 17-year-old girls can be bad news for middle-aged men.
See "apple does not fall far from the tree."