Posted on 10/04/2021 12:18:18 PM PDT by Beave Meister
Ah, from arstechnica.com (am increasingly strident site regarding vaccinations):
“The root cause of the worldwide outage appears to be a flubbed BGP route update.”
That’s why the Facebook’s DNS servers can’t be found.
If true, it’s going to take time to heal.
Some teenager in Iowa is just laughing his/her butt off.
Unintentional internal sabotage is the most effective kind. :)
“Well crap, what will I do?”
Worse than that, how do I find out if my kids are ok, or even alive?
I guess I can walk into their bedrooms, but I’ve never done that before. Should I knock first?
what are Congress-people is session going to do now? They spend all of their time with faces in cell phones.
I will bet a large amount of money that the poor responsible network engineer is either in India, or has an H1b visa.
“China may be the one who pulled Facebook down.”
I may have to rethink my position on China. By taking down Facebook, they’re doing FAR MORE to level the political playing field in the US than the Republicans, Rand Paul, or the Courts are doing.
Router updates during the middle of the day for most of your customers just scares the crapskies out of me.
Sounds like the updates were done remotely and they locked themselves out of access to the routers needed to correct the problem.
Even rubes like us use OpenGear to get remote access to devices we can’t reach if the Interwebs are down. Cradepoint makes good products also.
A config change tested in production. Lovely
Lack of a DNS entry does not mean a domain name is for sale.
A team of couriers are probably enroute from SFO to Libya right this moment... lol
facebooknow.info is $3.99. Almost tempting, don’t know what to do with it though.
https://www.godaddy.com/domainsearch/find?checkAvail=1&domainToCheck=facebook.com
Thank You!!
Cloudflare senior vice president Dane Knecht notes that Facebook’s border gateway protocol routes — BGP helps networks pick the best path to deliver internet traffic — have been “withdrawn from the internet.” While some have speculated about hackers, or an internal protest over last night’s whistleblower report, there isn’t any information yet to suggest anything malicious is to blame.
I’ve been out of network management for 22 years, but every destination needs a root server entry, and that seems to be gone. Whether an organization has its own DNS server is immaterial.
Maybe the CHICOMs asked Fraudbook to do more internal censoring and Z blew them off so this was a “You need to reconsider your reply” event.
A little story.
We upgraded Internet service from a large carrier on which our primary DNS server resides. So it's critical. I made sure to tell the carrier that you need to take the config from the existing Cisco router for our routes and port it over to the new Cisco router, taking into account any code changes that make commands on old router not work on new router. NO, I should not have top tell them that, but I did (and do).
But the initial engineer mucked up the porting. It took multiple phone calls and one week to Mumbai to get the information ported correctly. In the interim, we had connectivity problems both inbound and outbound due to the config being ported over in an incomplete manner.
HT - Thank you PingPlotter for your tools that helped provide additional information to confirm it was the carrier and not us. The carrier sales rep wanted to talk with us about BGP and I said NO WAY, NO HOW.
By the way some of the engineers in Mumbai were very good, but a couple were not and it caused no shortage of grief and heartburn.
BTW our DNS worked fine during all this - we just could not push changes as the Primary was down. We could promote a Secondary to a Primary but I kept being told "we almost have it fixed".
Knock first, lol!
Understood - I have my own DNS server here. It’s effect is obviously limited.
But whois facebook.com shows a.ns.facebook.com (etc.) as their nameservers. Not unheard of, just shows they are big fish in the DNS sea.
Disclaimer: Opinions posted on Free Republic are those of the individual posters and do not necessarily represent the opinion of Free Republic or its management. All materials posted herein are protected by copyright law and the exemption for fair use of copyrighted works.