Sorry, but he’s a lawyer. Thats his job. What would you prefer he say?
How about, "I cannot, in good conscious, take this case."