The word I heard locally is that they had a ton of servers plugged into normal power, not UPS backed by a generator power, and had a power outage that took all those servers down.
This is what happens when you let computer techie types run the old-school basic infrastructure, is my take. Stick to your OS updates, guys, and hire someone who understand electrical and mechanical systems.
I’ve been in IT since I started coding in COBOL in 1983. I can not imagine a “serious” company operating with power backup. Heck, way back in the late 80’s I worked for a bank. Every month there would be a strong diesel smell because they were firing up the emergency backup generators outside our office windows.
Delta’s Disaster Recovery management should be terminated. Seriously.
Actually, this is more likely to be the result of a non-techie doing the racking-and-stacking. We techie folks generally understand the necessity of redundant power supplies plugged into independent circuit legs, because we’re the ones who get called if the server goes down. It’s the non-computer folks who don’t usually realize that the wall sockets aren’t necessarily part of the UPS circuits.
Interesting. Most IT people I know are always pushing to get the latest in power source, generator, etc.
We used to have hardly any floods here because we had humans on the spot watching the water. These days, there’s always the fear of flooding because the watchers are sitting behind a computer screen two hours away. Last time I called to complain about them opening up too many gates at the dam causing it to flood us, I was told in no uncertain terms that I was lying because their computers showed normal water levels.
What will I do when the grid gets hit? I’ll immediately go into FR withdrawal. Then cuss because the freezer is out. Then jump for joy because the phone won’t ring with annoying telescammers and no more noisy weekenders. After the first 5 minutes, it’ll be just fine. After a couple months I’ll be cussing again because the repairs won’t be anywhere near us.
“This is what happens when you let computer techie types run the old-school basic infrastructure, is my take. Stick to your OS updates, guys, and hire someone who understand electrical and mechanical systems.”
Many of the people who designed this are probably gone. Also, they probably never tested this outside of an annual table top exercise. Finally, their risk analysis probably said the chance of this happening compared with the costs of running true tests probably didn’t warrant a live test.
FAIL!!!
LOL! What a clown show!
A lo t do.
A lot asked for decent battery backup systems and were told it was not a budget priority from the business and accounting types. And to just make do with what was already on hand.
Been there. You want to stereotype? We can stereotype.
I suspected a hack.
"Computer techie types" know that servers and routers don't work without power. More likely the fault of "manager bean-counter types" who saw a way to "save money" and ordered corners to be cut.
Sorry - if you ask the techies, they’ll tell you, at a minumum, to put in UPSs to allow a graceful shutdown.
Generators are better.
Running tests where you pull the plug completely to see if the generators come on line or the UPSs allow the graceful shutdown are best of all.