Yes and no. Your private key is still useless without the passphrase, and you never, EVER leave that on ANY computer.
I have ONE written copy of the passphrase, in the safe with the rest of my passwords, in as tamper-proof a package as I can make it. My wife has instructions to open it IF something happens to me. . .