Well, would you risk what might become a lifetime in prison, for taking your gun after a common, opportunistic thief?
Are you willing to bet that he won't "accidentally or on purpose" find a woman, child, elder or infirm person home alone?
That he won't steal a gun and use it for a terrible purpose?
That he won't "accidentally" push an elderly widow, that didn't trust banks, down the steps to her death while absconding with her life savings?