Oh, yes, there are illegally owned guns.
They are illegally owned once they have been stolen. The thief can be a burglar, a thug, or an agent of the state.
Technically they are not ‘owned’ by the thief, or whoever, but are in their ‘possession’, hence ‘possession of stolen property’...........