That is how I view the matter. I think Saruman *was* active during this period. I also think it was Saruman that they saw on the edge of Fangorn later on.
I also agree that Legolas was naturally more resistant to Saruman's power, but also remember in FotR, when Glorfindel met Aragorn and the Hobbits, that he led them for a time and they walked so long that even Aragorn seemed weary at the end, but Glorfindel was tireless. Admittedly, Glorfindel is exceptional even for an Elf, but the fact remains, and Aragorn was exceptional for a Man.
Tuor
And yes, Aragorn is exceptional for a man... I have seen him with my own eyes! (still just giving you a hard time about the film ;~))
Yes, absolutely. First, they saw Saruman and later, of course, met Gandalf (the white).