Don't you think reference would have been made that Noah had with him on the ark any writings of Adam? I am doubtful that Adam penned any of Genesis simply because of what is said, although the English translations do not quite capture the whole story.
Noah may well have wrote I have no evidence to say otherwise, but everything I have studied seems to point to Moses being inspired to pen those first five books, especially with what Christ said about Moses. Also I have read that it is believed that Moses also penned the book of Job. Makes sense to me that Moses would have penned the book of Job considering how the story of Job does as much as any other book to explain Genesis and the players in time.
But I add I do not have a closed mind on the matter.
I have been studying the Book of Genesis intensely for 4 years. My studies have led me to conclude what I wrote below. If you are interested in more information, drop me a line.