Plessy v. Ferguson has never been overturned, although finding the Civil Rights Act of 1964 constitutional had the effect of making Plessy moot.
The Brown v. Board decision was not based on overturning Plessy, and there were not five votes to do so. It was based on “new findings in psychological research”.
New findings - the route to rendering Roe nugatory.