On the video I linked to shows he is driving much too fast for an area filled with pedestrians. He should have never gone down that road and reversed out right away. He is obviously good driving in reverse. I think he was looking for trouble and he found it.
He might already have been escaping a previous threatening crowd. There were many encounters and acts of violence taking place in Charlottesville during those hours.