I believe at the time Maine was considered part of the Massachusetts Bay Colony and Vermont was considered part of New York, although New Hampshire disputed that.
Vermont was pretty adamant that they did NOT want to part of NY...on ME, ya got me...