The ascension, the waiting in the upper room and the Holy spirit coming at Pentecost were different events but they were the same participants who were waiting for the endowment on power, the Holy spirit, promised by Jesus. This was a narrative letter. There were no chapters and verses. When Luke says "And when the days of the Pentecost were accomplished, they were all together in one place" he is talking about the 120 people who were together in the upper room waiting. When Luke says in Acts 2:3 "And there appeared unto them cloven tongues like as of fire, and it sat upon each of them. And they were all filled with the Holy Ghost, and began to speak with other tongues, as the Spirit gave them utterance" he is speaking about all that waited including the women, otherwise the statement makes no sense.I understand that this is your interpretation.
Then they gave lots to them, and the lot fell upon Matthias, and he was counted with the eleven apostles. When the time for Pentecost was fulfilled, they were all in one place together.To my eyes, this says that the twelve were together and implies nothing more. But I understand if you disagree.
Notwithstanding that, the Pentecost needs to be seen in the context of the promise of Pentecost in the four Gospels, that I posted. The promise was made to the eleven. The breathing of the Holy Ghost in Matthew was to the eleven. The commision to teach and baptize was to the eleven. The scripture in acts surely does not contradict this interpretation even if others received the Holy Ghost as well. Surely we think that the Blessed Virgin received the Holy Ghost, -- she was His spouse after all. But the pivotal thing is who got the Commission? The answer is, the eleven, plus St. Paul.