“Who is going to verify that the AI-generated code will actually work?”
That is an interesting question.
How do we all know you will work correctly?
In the Mathematic world it is all Set theory.
How you choose to use that data is by design.
Computers by their design require 7 conditions for them to operate in a reliable predictable fashion.
AI is stuck with that.
People are not.
Y’all come up with a AI machine that thinks like a human then you have a BIG problem.
I can explain why 2+2 does not always equal 4.
I was a Math major at one time.
Much of what we do is based on beliefs.
Kind of like this sudden fear of AI.
I remember all of this talk when CASE tools came out in the 90s.
I presented ChatGPT with an engineering problem and asked for a solution. ChatGPT happily provided an answer. I asked ChatGPT to show its work. It provided the accompanying calculations. The answer was incorrect. I informed ChatGPT that it was incorrect and why. It apologized and revised the response to the correct answer. The bridge would have fallen down without human interaction.