Except that Rudy took guns away from long-term NYC permit holders for no fault of their own.
Most likely you are speaking of pistols and NYC residents can still own guns. However, Guiliani did not create laws making handguns illegal in any case. Executives must execute the laws enacted.
The vast majority of guns confiscated were those of criminals. The others are regrettable.