I read an interview with him where he as much said the same thing. People wouldn't offer him roles for a few years because he was so indelibly etched in peoples’ mind as Jim Jones.
That makes a lot of sense, another actor who I think fell into that trap was Steve Railsback, who portrayed Charles Manson in “Helter Skelter”.