Never fly fished for bass but I've always wanted to. All my fly fishing is for trout in NC. Maybe it's time to branch out.
A hatchery trout, as most eastern trout are, are looking for something in pellet form, and not flies.
That could explain why you catch more fish on bait than on flies.
It can get a lot better than that, and I would encourage you to branch out.