I lead a few AI projects.
95% of pilots don't make it to production or fail to deliver measurable financial impact.
AI needs to be constantly tweaked and that creates technical debt too.
So your doom and gloom scenario is a few decades away.
Don't buy into the media hype about it too much.
I've watched AI video and how it has progressed in one year. Do I think its actual intelligence? No. It isn't close. But its one hell of a lot closer to the Star Trek computer model than we had 2 years ago. Right now we are at Google + mode. With some added intuitive structure.
But this shit is exponential. Once they figure out how to monetize properly, probably by subscription for an advanced model, with a basic available for public use with advertising, it will be packaged and sold with specific jobs in mind. Legal, payroll, customer service, pizza ordering, whatever.
It will be used to program picking bots in shipping receiving, connected to ordering, payments, hell even 3D on the spot printing.
It's going to come hard and fast. Look what the IPhone did in 2006, Blackberry when it hit. It will change shit in ways the CEOs haven't figured out yet.