The fact is, Saturday evening gatherings are what is spoken of in the Didache. This is what Acts 20:7 clearly references. In the Scriptures, the day ALWAYS begins at sunset.
Indeed you are correct that the day begins at sundown and ends at sundown the next day. That is why the Catholic Church has Saturday evening and Sunday Masses, because Saturday evening is Sunday.