Yes, it seems to be a matter of definition.
They could say that the heavily armed federal agencies don’t have nukes, so they’re not a “military unit”,
and we could say they shouldn’t have pointy sticks.
If they’re a law enforcement agency, they need a means of enforcement, but they don’t need APCs & automatic rifles.
In that case the Marines aren’t a military unit either.