I generally agree with you that hate crime statutes are bad. However I also believe that the law should be equally enforced; "equal protection under the law".
Firearms laws were Jim Crow era laws to prevent blacks from access to guns. Those laws started to be fixed when the cops started enforcing them against whites as well.
Since hate crime laws imply (if not outright create) protected classes, then they are inherently contrary to the fourteenth amendment’s “equal protection” clause.
And how does one apply such statutes equally since they legislate on thought rather than action?