So if bacteria can reproduce many, many times every minute, and it still takes one billion years, wouldn't it take several trillion years for an organism that reproduces only once every few years?
No. Organisms that reproduce only once every few years tend to have greater genetic variation from parent to offspring, which means that it will evolve faster.