My take on it is that he would have loved to recommend prosecution but knew that considering Lynch would have to do it he knew it would go nowhere with Lynch and Obama.
The speech he gave afterwards let the public know that she is guilty even if not formally charged. My take is that he showed that she is not qualified and too stupid to be President if she is too stupid and careless to protect classified information.
So he agreed to be the fall guy.