"If there is a perp heading to the Canadian border why should the CBP not be looking for that person? "
It's not a CBP function, they have no authority to stop anyone leaving.
Tell that to recipients of DUIs who try to get across the border anyway, get stopped for search and get sent right back home.