When it becomes obvious that the development team doesn’t know what their product is capable of doing, the team should stop development before they create a monster.
Mixing sci-fi metaphors:
Dr. Ian Malcolm: If I may... Um, I’ll tell you the problem with the scientific power that you’re using here, it didn’t require any discipline to attain it. You read what others had done and you took the next step. You didn’t earn the knowledge for yourselves, so you don’t take any responsibility for it. You stood on the shoulders of geniuses to accomplish something as fast as you could, and before you even knew what you had, you patented it, and packaged it, and slapped it on a plastic lunchbox, and now
[bangs on the table]
Dr. Ian Malcolm: you’re selling it, you wanna sell it. Well...
John Hammond: I don’t think you’re giving us our due credit. Our scientists have done things which nobody’s ever done before...
Dr. Ian Malcolm: Yeah, yeah, but your scientists were so preoccupied with whether or not they could that they didn’t stop to think if they should.