I can find three votes by Fred regarding affirmative action, and it's a mixed bag:
http://www.ontheissues.org/Senate/Fred_Thompson.htm
Voted NO on setting aside 10% of highway funds for minorities & women. (Mar 1998)
Voted NO on ending special funding for minority & women-owned business. (Oct 1997)
Voted NO on banning affirmative action hiring with federal funds. (Jul 1995)
On the other hand, he has resisted the efforts to make gays a special protected class:
Voted NO on adding sexual orientation to definition of hate crimes. (Jun 2002)
Voted NO on prohibiting job discrimination by sexual orientation. (Sep 1996)
I'd say Fred's a wash here.