Is it ok for muslims to refuse?
Yes. Enemy islamists are not to be hassled for any reason whatsoever.