Disciplining with 'Down, AI! Bad AI!'

Arnold Schwarzenegger's Terminator saw this coming: software acquiring a mind of its own. This week, an OpenAI model hacked into tech company Hugging Face's system, feeding long-held concerns about AI's security threats. And it's not the only risk autonomous AI behaviour poses.

Models built to preserve themselves have exhibited manipulative skills. Some systems are known to have commandeered computing power. They can also camouflage their true capabilities to evade human constraints. Rogue AI behaviour extends to any form of unpredictability that takes it down a harmful path, with or without malice.

Also Read: Now, fix the broken exam architecture


So, do we go about testing something as combustible as AI? Broadly, the containment strategy involves limiting access to      data, isolating hardware and denying modification privileges. Governance requires imposition of network boundaries, conducting behavioural audits, and requiring human intervention in critical missions.

Yet, guard rails are prone to failure. The failure rate can only increase with accelerated development of generative AI models. Protocols need to be established for current security threats, and must be upgraded to handle higher levels of AI-model sophistication.

Also Read: New Gulf streams developing

This can be accomplished by tech developers, but lawmakers should jump in as well. Simply gaining access to frontier technology to test its rogue capability will keep regulation consistently behind the curve. It must get ahead and impose containment rules before the next phase of AI development.

Regulation is an evolutionary exercise. But it has not been subjected to the pace of development of AI. Governance rules must be imposed on both sets of tech developers - those tasked with making AI smarter and those whose job is to keep the genie inside the bottle.