if you accept the Sabbath as for "everyone" accept all the other Mitzvas too. if not, than acknowledge that G-d was talking to Bnai Yisroel. B'nai Yisroel is a specific family which became a nation. it is NOT universal.
The Sabbath and the other Feast days listed in Leviticus 23, such as the Feast of Tabernacles are for all people. God originally gave them to the House of Israel, but the Feasts were God's Feasts. He never intended to limit them to the House of Israel. Notice in Isaiah 66:22-23 how in the Kingdom of God, everyone will come to worship the true God on the Sabbath
22For as the new heavens and the new earth, which I will make, shall remain before me, saith the LORD, so shall your seed and your name remain.
23And it shall come to pass, that from one new moon to another, and from one sabbath to another, shall all flesh come to worship before me, saith the LORD. (KJV)
Isaiah 2:2-4 shows how many nations will want to come to Jerusalem to learn the law of God more perfectly.
In the Kingdom of God, all nations will have to keep the Feast of Tabernacles also. If they refuse to do so, they will not receive any rain as shown in Zechariah 14:16-19:
16And it shall come to pass, that every one that is left of all the nations which came against Jerusalem shall even go up from year to year to worship the King, the LORD of hosts, and to keep the feast of tabernacles.
17And it shall be, that whoso will not come up of all the families of the earth unto Jerusalem to worship the King, the LORD of hosts, even upon them shall be no rain.
18And if the family of Egypt go not up, and come not, that have no rain; there shall be the plague, wherewith the LORD will smite the heathen that come not up to keep the feast of tabernacles.
19This shall be the punishment of Egypt, and the punishment of all nations that come not up to keep the feast of tabernacles. (KJV)
The Feasts that God gave to the House of Israel are now for all people. The weekly Sabbath and annual Feasts are God's Feasts.