And there is no convincing me that I am wrong or that this mistake is not that big of a deal
should say "not that big a deal", not "not that big OF a deal".
Which kind OF deal was that? Not that big of a deal. Using "of" is not incorrect here.