If it was a network printer, the printer probably had a fixed IP address that may not be recognized by the new router...start there....
Since you have a small network, your computers are probably set for DHCP so they can recognize any new IP address....Printers generally are not that way.
If your printer is DHCP capable, then the new address assigned is not recognized by printer config file in each PC....
Thanks.
After I set up my home network, should I be able to see it under "network connections"? I don't right now. Thanks.