I believe it was rumors of this affair that enabled Kerry to knock him off.
Brooke was beaten by Paul Tsongas in 1978. You think his affair with Barbara was an issue?
I do remember that 1978 election night and Barbara was talking with the newly re-elected Sen Chuck Percy and congratulating him while all he wanted to do was lament over the defeat over his good friend Ed Brooke. Barbara was actually a little embarrassed. Maybe she wanted to just change the subject.
Of course 6 years later “RINO” Percy also was defeated for re-election.
Kerry never ran against Brooke. Kerry succeeded Paul Tsongas after beating Ray Shamie, a Republican.