I would say, it could work, but maybe test it out. Will it be thick enough? I have sometimes used flannel. Nothing is crazy, and don’t overlook Goodwill or similar stores for possible batting/filling options, depending on your project.
I’ve also used flannel. A local quilt teacher and friend uses wool. She said it is great for a summer quilt. I haven’t tried it though.