Probably because he would get a challenger in the primary if he did.
I don’t know, Bob Roe was a democrat congressman in the same district who voted pro life and, after the influx of so many new Hispanic immigrants, the district is more catholic than it has been in the past. Also, Paterson has a very-large Muslim population that is pro-life and anti-homosexual. Pascrell votes the opposite of his many constituents.