If the router is new -- i.e., you haven't had one before -- you may need to run the 'Network setup wizard' that's found in the Control Panel (on the XP machine).
I tried that but I will run it again to make sure I did everything right.
The printer icon on the desktop now has a outstretched hand which I am assuming means that this printer is shared.