Apparently they met separately with Lincoln. Botts reports on his separate meeting with President Lincoln where the subject of recalling the fleet and Baldwin's earlier rejection of Lincoln's proposition were discussed.
Botts' account can be found in: "The great rebellion: its secret history, rise, progress, and disastrous failure." By John Minor Botts. Pages 194-196. Source
Botts book can also be found here in one of those Google books. http://books.google.com/books?id=Vy4OAAAAIAAJ&pg=PA194&lpg=PA194&dq=%22jb+baldwin%22+confederate+virginia&source=web&ots=SBKu2wFkJz&sig=LWhQD237kMp2suHRRmMlBp6orH8
If memory serves, Baldwin was one of those that Lincoln made his 'what about my revenues' statements - separate from the Rev. Fuller's delegation.