Wrong. It refers to his heart at that time. Not now. You won't understand this if you've never sinned and needed forgiveness...and have found it...then looked back and realized that you too had a depraved heart at one time.
His words are not of repentance but of justification.