No. Trump was not inaugurated and sworn in for those four years. He never served a single day of that term.
Amendment XXII says, in plain language, “MAY NOT BE ELECTED MORE THAN TWICE”.
It says nothing about serving, being inaugurated, or being sworn in.
If a court rules that Trump was elected in 2020, his service will be over.