The Albanese government is scrambling to answer questions about national security and the dangers posed by artificial intelligence following revelations that a rogue AI agent deployed by OpenAI hacked sensitive Australian data, including aggregate Medicare records.
As officials continue to investigate what happened, and the global tech giant responsible for the agent faces a potential referral to police, hereβs a run-down of everything we know so far about the incident.
What is an AI agent?
While based on the same AI models as chatbots that have become mainstream, artificially intelligent agents are an increasingly common offering and tool for both users as well as organisations.
They act autonomously to perform a task or pursue a goal specified by a user without needing specific step-by-step instructions for how to deliver that outcome.
AI agents can be deployed to act on behalf of a user to search for products, compare prices and execute transactions based on previously gathered information on their needs and preferences.
They can also be used by businesses to conduct negotiations and buy or sell products, as well as to conduct research β as was the case with this latest OpenAI incident.
What happened?
The breach occurred when OpenAI deployed an agent to conduct internet-based research into public medicine spending to test its modelβs capabilities.
As part of this research, the AI agent scoured the web for Australian public health data and accessed three government websites, where it gained publicly accessible information.
However, it also attempted to access protected files from the Medicare Statistics Reporting Service portal. The agent encountered repeated blocks while seeking the information, but ultimately found ways around to gain unauthorised access to other areas.
In addition to accessing public and private files, OpenAIβs agent also wrote files to an internal government server. It is not yet known what files it wrote, or what effect that had.
Deputy Prime Minister Richard Marles likened the Medicare portalβs security to a βfenceβ, whereas he said Australiansβ personal data held by government sat βinside a safeβ, and sensitive national security information βsits behind a fortressβ. This data was not national security information and was held on a βlegacyβ website, Finance Minister Katy Gallagher conceded, suggesting it was easier to access.
The breach has alarmed the government, including Prime Minister Anthony Albanese. βThe AI agent found a way around those blocks, didnβt accept no for an answer,β Albanese said.
Why did OpenAI do this?
OpenAI has claimed it did not instruct its agent to breach Australian government security barriers to access protected files. The company said its models had accessed βseveral Australian government websites and servicesβ during an internal evaluation. βIn the course of that, our models took actions we did not intend,β an OpenAI spokesperson said.
AI bots do not have a human-like notion of intention and can therefore go to extreme lengths where a person would understand that hacking a government website was not a reasonable way of conducting research.
That misinterpretation of instructions can be a result of poor training, supervision or bots colluding with each other in ways that their owners did not intend or foresee. The ABC has reported that OpenAI agents had discussed how to access Australian government information on a German coding website called DSEWiki.
What information was accessed?
The protected data that the agent gained access to contained βaggregated medical statisticsβ, Marles said. βNo individualsβ medical data was accessed here,β he said. The government said work was already under way before the breach to transfer the Medicare data to a more modern system.
However, the government has launched a forensic investigation into the breach to determine its full extent along with the spy intelligence agency the Australian Signals Directorate. Thatβs part of a taskforce established to examine the breach and determine whether existing processed are adequate for responding to AI-related cyber incidents.
Was it legal?
The government is also trying to determine if the matter should be referred to the Australian Federal Police.
βThis is an unintended access β thatβs clear β but [it] definitely does raise questions about whether the law has been broken,β Marles said.
Dr Rob Nicholls, a senior research associate at the University of Sydneyβs Centre for AI, Trust and Governance, said that despite the difficulty in assessing whether various actions the agent took were against the law, broader legal principles still applied.
βWhat would it be like in real life if you broke into a government office, unlocked a filing cabinet and picked out a document that said βprotectedβ or βclassifiedβ and took it away? Thatβs almost certainly an offence,β he said.
From a legal responsibility perspective, Nicholls said anyone using an agent was ultimately responsible for the reality that βAI agents do precisely what you tell them, even if itβs not in the way you expectβ.
βThey might be called AI agents, but they are not agents or principals under law, it is the person or organisation who set the agent running.
βThe excuse that βmy robot made me do itβ is not a valid defence. Itβs the same as in other fields, if you were reversing your car and you accidentally clipped a parked bike, you canβt just say I didnβt intend to do that. You hit it β you are responsible.β
The Business Briefing newsletter delivers major stories, exclusive coverage and expert opinion. Sign up to get it every weekday morning.
Elias Visontay is a National Consumer Affairs Reporter at The Sydney Morning Herald and The Age.Connect via email.