Ultimately, priest forgive sins In Persona Christi, in the name of Jesus, not on their own intrinsic authority.
The priest, with his authority to forgive sins via the sacrament of Reconciliation, is also an earthly visible reminder of the need to repent.