It’s a lot more than “averages” though. I know you must be familiar with neural networks but there’s layers and layers of NN interactions that achieves something far more special. Passing medical and Bar exams at levels above average is quite impressive - although I’d agree, for those, that does become largely training + word sequences, via vector databases. But the ability to compare and contrast complex topics, analyze pictures, deconstruct UML diagrams into requirements, use-cases, solving equations, etc.., is like having an expert consultant sitting next to me. A tool I use every day.
At some point the distinction between “thinking” at a biological level vs. “simulated in technology” is going to be hard to define. Some would argue it’s already there.
This example is nothing more than lack of effective QA testing. It’s embarrassing to the profession - but hey, it’s not FuSa related with no liability. This was just inexperience and being cheap respective to developers and testers.
It’s also inevitable. Any time there’s new technology the initial hiccups happen. Anyone thinking this is some sort of passing fad is going to be disappointed.
I use the term “averages” for the common person to understand the concept. Trying to have someone to understand such concepts as quantitative segmentations and, yes, fuzzy logic *snicker*, is difficult.