I just X'ed out and didn't do anything.
You can re-run the setup and choose to not install the avg toolbar or uninstall and reinstall, only this time do not choose the avg toolbar.