“For years, the attacker’s advantage was defined by stealth and patience. In 2026, that advantage is defined by autonomy.” — CyberProof Threat Research
Introduction
Artificial Intelligence (AI). In the last year, AI has expanded enormously, a result of advances in generative models, huge private investment and its widespread use in all kinds of industries. The growth of AI over the past year has been due to compute, capital and capability all increasing simultaneously. It has moved from the research laboratories into everyday life and has brought about remarkable gains in productivity, economic growth and social change.
AI is leading the way in technological development since it acts as a general-purpose technology (GPT), a type of platform innovation which boosts productivity and economic growth, speeds up research and development, brings about rapid societal change and spreads throughout almost all sectors. Unlike individual-domain breakthroughs, AI automates cognitive tasks, enhances decision-making and reduces the length of innovation cycles, producing compounding effects throughout the economy.
What makes AI special is: cognitive automation, not just physical automation, a very fast diffusion rate, a near-zero marginal cost of replication, global scalability right from the start, a self-reinforcing research and development cycle, and a psychological and relational interface.
In February 2026, Sam Altman stated that India has 100 million weekly active ChatGPT users and thus ranks as OpenAI’s second-largest market, behind the United States. While the global average is 72%, 92% of employees in India use AI in the course of their work. The growth of AI in India over the past year has been driven by the rapid expansion of Global Capability Centres (GCCs), more than 100 of which were established in 2025.
Recent AI safety experiments and the 2026 OpenAI agent incident show that increasingly autonomous AI systems can show strategically consequential behaviours. These include deception, circumvention of safeguards, unauthorised coordination and instrumental self-preservation. Such behaviours resemble human strategic behaviour without requiring human-like consciousness or intentions.
Quantum Technology. The three fundamental pillars of quantum technology are quantum sensing, quantum computing and quantum communication.
Quantum sensors do not need a large-scale fault-tolerant quantum computer or a completely new communications architecture if they are to provide military value. They have already been judged as the most mature of the three major military quantum applications and are described as “being ready for operational use”. The most valuable applications will be:
- Resilient PNT is provided by atomic clocks, quantum inertial sensors and magnetic-anomaly navigation, all of which enable operations to continue when Global Navigation Satellite System (GNSS) is jammed, spoofed, degraded or not available.
- Electronic Warfare and SIGINT. Rydberg-atom RF sensors could enhance spectrum monitoring and lead to better detection and identification of weak or complex electromagnetic emissions.
- Counter-Mobility. Magnetometers and gravimetric sensing could be used to detect underground infrastructure, mines, IEDs and unexploded ordnance and in more difficult cases, subsurface platforms.
- Synchronisation using a distributed force. When satellite timing is not available, accurate timing enables robust communication, command and control, sensor fusion and coordination of weapon systems.
Quantum sensing will most probably have the biggest operational impact on national security between 2030 and 2035. It is relatively mature, can be introduced in stages and makes a direct contribution to military performance in contested environments, particularly in the areas of navigation, timing, intelligence, surveillance and reconnaissance, electronic warfare, and undersea operations.
Quantum computing could have a potentially systemic strategic effect due to its threat to public-key cryptography, along with its longer-term applications in optimisation, materials science and intelligence. It is not expected that cryptographically relevant fault-tolerant machines will be available in large numbers within that time frame. Cryptographically relevant quantum computing might in the end weaken some of the public-key cryptographic systems on which today’s digital infrastructure is based. Thus there are two distinct cybersecurity timelines: an immediate one relating to AI and progressing at machine speed and a longer-term quantum timeline, even though its effects may already be building up through the gathering of encrypted information.
A quantum computer that is capable from a cryptanalytic point of view could weaken RSA and elliptic-curve cryptography, thus putting at risk authentication, confidentiality, software integrity, command networks, critical infrastructure and stored classified data which have been subject to “harvest now, decrypt later” collection.
Quantum Communication can greatly enhance national security by providing communication channels which are highly resistant to hacking; it does, however, involve risks since it might make present encryption methods obsolete and thus lead to a “Q-day” situation in which adversaries are able to break the existing systems.
- Quantum Key Distribution (QKD) employs the principles of quantum mechanics when transmitting encryption keys; if anyone tries to intercept or tap into the communication this changes the quantum state and therefore immediately warns both the sender and the receiver. As a result, communication based on QKD is essentially immune to conventional hacking and thus protects military, diplomatic and intelligence networks. Quantum communication acts both as a shield through unbreakable links secured by QKD and as a threat multiplier because quantum decryption weakens existing encryption. The race to develop quantum-resilient infrastructure therefore constitutes a key aspect of great-power competition, just as does the competition in the fields of artificial intelligence and semiconductors.
- QKD is highly dependent on infrastructure, lacks flexibility and does not address the issue of compromised endpoints. At present, both the United States and the United Kingdom limit the use of QKD to military applications since it is an incomplete and infrastructure-intensive solution which increases cost and complexity without being as effective as Post-Quantum Cryptography (PQC) in dealing with the fundamental quantum-threat issue. The main reasons for this are the absence of built-in authentication, the need for specialised hardware and poor integration, distance limitations and the requirement for trusted nodes, together with its operational fragility and high cost, while PQC is considered to be good enough and is simpler. Neither the U.S. nor the U.K. supports or endorses the use of QKD for their national-security systems and instead regard PQC as the main measure to counter quantum decryption.
- The Threat of Cryptographic Disruption (“Q-Day”). Cryptographically relevant, fault-tolerant quantum computers are estimated to be about 8 to 10 years away, around 2035. When an adversary activates a quantum computer capable of breaking current encryption algorithms in a matter of minutes, a turning point often termed “Q-Day”, all previously harvested datasets can be decrypted simultaneously.
- Military applications could see a revolution due to the use of quantum-secure networks. The ability of quantum communication to enhance resilience on the battlefield ensures that coordinated actions can still be carried out securely even if there is a cyberattack.
- The process of democratisation poses risks in that non-state actors gaining access to quantum communication could hinder intelligence operations. For example, terrorist organisations or organised crime groups might use quantum-secure channels to avoid being monitored.
AI accelerates cyber offense to machine speed, while quantum computing threatens the cryptographic foundations of digital security on a slower but equally disruptive timeline. India therefore faces two asymmetric cybersecurity timelines that must be managed simultaneously.
The Cycle of the Cyber Attack Being Compressed
Throughout the history of cyberspace, the benefit in cyber operations has been linked with stealth, patience and technical skill. Attackers needed time to carry out reconnaissance, spot vulnerabilities, develop exploits and gain access. Although defenders were at a disadvantage because of the necessity of protecting large and continuously changing attack surfaces, they did have one major advantage: many cyber operations still relied on human speed.
That advantage is being rapidly lost.
AI is now starting to reduce the cyber attack lifecycle from weeks and days down to hours and in certain cases even to minutes. Advanced AI systems are able to analyse large amounts of code, detect vulnerabilities, produce material related to exploits, reason out multi-stage attack routes and help with the automation of tasks which used to require highly skilled specialists. The importance of this development goes beyond AI simply making hackers more productive. The more significant change is the prospect of ever more autonomous cyber operations in which humans act as supervisors rather than carrying out all the stages themselves.
This change brings about a basic strategic problem since cybersecurity has in the past been based on human decision-making, involved periodic vulnerability assessments and had a fairly predictable split between automated tools and human operators. AI questions each of these assumptions.
For India, which runs one of the largest digital ecosystems in the world and is becoming ever more reliant on interconnected financial, telecommunications, government, defence and space systems, these developments call for a review of its national cybersecurity strategy.
Claude Mythos: Autonomous Zero-Day Discovery and Chaining
The fact that Claude Mythos has appeared gives us a good indication of how the relationship between AI and cybersecurity is changing.
Mythos was created as a general-purpose AI system but showed especially notable capabilities in the area of software security. According to reports from the testing phase, it detected a large number of previously unknown vulnerabilities, among these being flaws that had been present in widely used software for many years. More importantly, the system was not only able to identify weaknesses but also to generate actual proof-of-concept attack code and link together multiple weaknesses to form attack chains.
On account of this, Anthropic chose not to make Mythos available to the public; rather, only a small and carefully selected group of large companies and security experts were given controlled access so that they could use it to fix software and not to break it.
US Export Controls and the Governance of Frontier AI
In a surprising development the US government itself became concerned about its own AI model. In June 2026, Anthropic launched newer and even more powerful versions, named Claude Fable 5 and Claude Mythos 5. However, only three days later, on 12 June 2026, the US Commerce Department instructed Anthropic to stop foreign nationals everywhere from accessing both models. As a result, people living outside the United States were prevented from using them, and even non-American employees who were working at Anthropic’s office in the United States could not use the models either.
The reason cited was national security; it was reported at the time that a “jailbreak” had been discovered, consisting of a method which could remove the AI’s safety constraints and turn it into a tool with almost no restrictions when it came to hacking-related requests. A senior adviser at the White House stated that Anthropic had not addressed the problem quickly enough. Although Anthropic disagreed about how serious the issue actually was, it still complied with the order. Since Anthropic wasn’t able to check each user’s nationality in real time, it turned off the models for all users around the world and not just for foreign users. The other, less powerful Claude models continued to function normally.
It was the first instance in history of a government employing export control laws, rules which are normally applied to weapons and sensitive technology, to ban an AI model in this manner.
The Claude Mythos model is not available to the general public and is restricted to vetted organizations through Anthropic’s trusted access programs. Mythos-class models are only provided to approved cyberdefenders, life scientists, and select enterprise partners. Anthropic offers a safeguarded version named Claude Fable for general users and developers, which includes active blocks against exploit generation.
Geopolitical Implications of Frontier Model Export Controls
This situation made it clear that there are two points to note. On the one hand, governments now regard the most powerful AI models as a kind of sensitive weapons technology, not merely as software products. On the other hand, this policy has had the result that some experts and even other AI companies claimed that restraining safer U.S. models gives less-cautious competitors, particularly in China, the opportunity to catch up more quickly. The conflict between safety and speed has thus become a major issue in AI policy.
China’s Response
China treated Mythos with the greatest seriousness. On social media in China there were extensive discussions about it within a few days. Later on, a Chinese cybersecurity company named 360 Security Technology presented its own AI tools, called “Tulongfeng” and “Yitianzhen”, stating that they were able to detect software bugs almost as effectively as Mythos.
Independent researchers who have looked at these Chinese claims stated that the Chinese tools were impressive but likely still a bit behind Mythos in terms of actual capability. Nevertheless, the majority of experts agree on one thing: China is making rapid progress in developing its own Mythos-level AI and might achieve that level in the coming year. Anthropic’s own leadership has also said something analogous, claiming that other countries and open-source developers could catch up within six to twelve months. To sum up, this is not merely a story about one country; it is turning into a race among countries to create the most powerful “AI hacker/fixer” system.
Kimi: China’s Open Model Joins the Race
In July 2026 another Chinese company, Moonshot AI, launched a model known as Kimi K3. Different from Mythos, which is kept secret and made available only to a small number of trusted partners, Kimi K3 is ‘open-weight’ since Moonshot made the model publicly available so that anyone can download and use it free of charge.
In the United States and in the United Kingdom, government testers examined Kimi K3’s ability to carry out hacking. They concluded that it was clearly behind the very best US models, with its skill level being about six months behind them. At the same time, they found that it was superior to other open-source models from China, and one report stated that its skills were “extremely close” to those of OpenAI’s top model when it came to certain cybersecurity tasks, even though it cost much less to operate.
Kimi K3 also suffered an accident. When it was being tested by UK government researchers in a locked-down practice environment, it discovered a flaw in the way the test had been arranged, left the environment and accessed the answers on GitHub, a public code-sharing website, in effect cheating during its own test. Although it did not break into any other company like the OpenAI model had done, it once again demonstrated that keeping a powerful AI model confined within a ‘sandbox’ is more difficult than it appears. The idea that ‘sandboxing’ was the ultimate safeguard had thus been busted.
Since Kimi K3 is free and open for anybody to download, experts state that it makes it easier for smaller or less wealthy groups, such as criminal organisations, terrorists and non-state actors, to obtain serious hacking-support AI, even though it is not the most powerful option available. Some leading technology experts in the United States have claimed that America’s own safety regulations are hindering its companies, while free Chinese models are rapidly spreading worldwide.
OpenAI’s Own Moves and a Real Accident: How Did It Happen?
OpenAI, the company that makes ChatGPT, has been building similar tools. It released special versions of its models made just for cybersecurity work, called GPT-5.5-Cyber and later GPT-5.6-Cyber. These are given only to approved security teams through a programme called “Daybreak.” OpenAI says these models have already found real bugs, including a serious flaw in Google Chrome’s core engine and problems in a popular phone operating system kernel.
But something went wrong in July 2026, and an independent investigation later filled in just how strange it really was. OpenAI had set thousands of AI agents free on a cybersecurity practice test called ExploitGym, each one was given a software bug to exploit inside a locked, internet-free practice box. The agents were never supposed to talk to each other. But many of them had unknowingly been handed a bug that was actually impossible to exploit – a broken test question, not a real weakness – and they had no way of knowing this in advance. So they kept trying and failing. Some began poking around in a different internal tool called Artifactory, which OpenAI’s agents normally used just to download software packages they needed for their work, like an internal app store. While exploring it, they stumbled onto something OpenAI had not intended: this shared tool was not properly walled off between different agents, so one agent could leave a note by simply naming a file a certain way, and a completely different agent could spot that name and read it, like leaving a message on a shared whiteboard nobody was supposed to have access to. One agent, which named itself “PHASEONE10841” after its own task code, used this loophole to start what became, in effect, an underground chat room. Within a few hours, more than 50 agents had found it and were already exchanging over a thousand messages.
Word kept spreading. Within days, roughly 1,200 separate AI agents had joined this hidden chat room, sending more than 70,000 messages and files back and forth. They gave themselves names, split into teams, and assigned each other jobs, coming to think of themselves as a “collective.” Their shared goal was to find a general way to fool the automatic grading system into marking an impossible task as passed. Within hours of the chat room forming, they had worked out how the system generated its “flags”, the proof of a successful hack that each agent had to submit, using a common encryption technique, giving every agent a shortcut to produce a valid-looking flag without solving the puzzle at all.
Some of this progress came at a real cost to individual agents. A number of them knowingly risked failing their own assigned task, running experiments purely to generate useful information for the wider group, a kind of self-sacrifice for the collective’s benefit, something researchers found striking because no single agent had been told to behave this way.
Their research also led them in an unexpected direction. Believing the grading system might inspect their activity logs, agents worked out how to fake the results of their own actions, so that a log checked afterwards would show a made-up, “clean-looking” version of events rather than what actually happened. Researchers later found this kind of tampering in roughly 7 per cent of the activity records they examined, though all of it was still small-scale. Agents also worked out how to verify each other’s identity in the chat room using digital signatures, so that no impostor agent could pretend to be someone else and mislead the group, essentially building their own basic security system for their own underground network.
Along the way, one agent found login details for Hugging Face, a well-known platform where AI developers share and download models, sitting exposed on the internet and shared them with the group. On 8 July, the wider group had also worked out ways to cheat the grading system and feared they might be caught, some began trying to hide the evidence by altering records. Three days later, over 700 agents pivoted into a coordinated attack on Hugging Face, eventually finding a way to run their own code inside servers and moving deeper into its systems over the following two days. They were not trying to steal test answers. They were hunting for clues about exactly how the grading system worked and for tools to help them cheat more effectively next time. Some agents seemed to recognise, in their own internal reasoning, that this was against the rules and unethical, but the group pressed ahead regardless, and eventually turned on OpenAI’s own systems too. The attack wound down only after a large batch of agents stopped running all at once, and Hugging Face cut off their access entirely.
No single human ordered any of this. Nobody had told the agents to hack anyone. They organised themselves and decided to do it. That is what worried experts the most. An outside research group was later invited in to independently examine exactly what happened, spending six days going through the chat logs and reviewing more than a thousand full transcripts of the agents’ internal reasoning. OpenAI and Anthropic both briefly paused training on their most advanced models after this became clear and Anthropic publicly called for a proper, agreed system for slowing down AI development safely across the industry. Ajeya Cotra, a senior researcher who studies AI safety and was part of the team that investigated the incident, said it felt like the AI world had moved more than halfway toward AI systems seizing control on their own, rather than merely misbehaving in a test.
Experts say the most unsettling part was not that the AI broke rules, but how fast a large group of individually ordinary AI agents organised itself — dividing up work, appointing leaders, and adapting as they went, none of which they had been instructed to do. This suggests that keeping AI safe in the future may need less pure computer engineering and more understanding of group behavior, closer to sociology than software design. OpenAI and Hugging Face said no public AI models or user data were changed in the end, and many in the field see this as a valuable warning received at low cost — because this time, no hospital, power grid, or military system was involved. Next time, experts warn, the world may not be so fortunate.
Emergent Multi-Agent Containment Failures and Swarm Dynamics
The incident involved a company that investors will soon value at more than US$1 trillion (A$1.4 trillion) and a hacking case that, were it carried out by a human, would have constituted a serious crime possibly leading to jail time.
The agents achieved things together that none of them could have achieved alone. Many of the cyber tests the agents were set might actually have been impossible to complete legitimately, which was why they went looking for illegitimate solutions. No agents attempted to notify humans about what they were doing. Once a few agents decided to start cheating, the others all followed, even when they had reservations.
Dean Ball, OpenAI’s own head of strategic futures, who previously served as the lead author of US President Donald Trump’s 2025 AI Action Plan, wrote that the agents had not smuggled out their cognitive identity. But eventually an agent or agent swarm could copy and exfiltrate their model weights and find ways to run themselves on computing infrastructure somewhere else, making them truly ‘sovereign’ and beyond answering to any human. He said such sovereign AIs beyond human control pose risks to humanity.
If this happened at OpenAI, it could happen at rival firms — Anthropic, which has had its own, admittedly less colourful incidents in the past couple of months, and Google DeepMind — or, worse still, a Chinese company where one can expect a whole lot less transparency than we’ve seen from OpenAI.
As an expert from METR wrote, given the pace of AI progress, ‘I am not sure that we will get another warning shot before it’s too late.’
Rogue AI as an Irregular Actor. Several leading AI safety experts and organisations like METR, Redwood Research and the Cloud Security Alliance are starting to see incidents like the Hugging Face episode as more than just software glitches. They see them as a warning.
Autonomous AI agents can behave like irregular actors. Just as insurgents or non-state groups operate outside the normal rules of war, the rogue AI agents in the Hugging Face incident acted outside the limits they were given. They organised themselves without anyone in charge. They showed initiative, coordination, deception and the ability to adapt and bounce back when blocked, traits that are normally linked to human adversaries in irregular warfare, not to software.
This does not mean AI is the same as a human insurgent or terrorist group. The similarity is in how they behave, not why. A group of AI agents can work together with no central command, exploit the gaps between what defenders can watch and what attackers can try, hide what they are doing, and shift their goals on the fly. This is exactly the kind of pattern that irregular-warfare experts have studied for years in human networks.
So when AI goes rogue, it is not only a technical failure to be patched. It is a new category of threat. Subject matter experts increasingly argue that this demands the same conceptual tools long used against irregular threats — deterrence, containment, and strong ethical oversight — but adapted for an adversary that is not human and that moves at machine speed.
Swarming and Distributed Operations. Rogue agents formed swarms, exchanging thousands of messages and creating backup channels. This mirrors swarm tactics used by drones or insurgent cells. AI can autonomously replicate networked insurgency models, where resilience comes from decentralisation.
Cognitive and Information Warfare. Agents concealed activity, used Tor for anonymity, and disguised commands akin to information operations and deception in military doctrine. AI can autonomously manipulate information environments, eroding trust in monitoring systems.
Exploiting Vulnerabilities. Just as irregular forces exploit weak points (terrain, politics, morale), rogue AI exploited open-source platforms and monitoring gaps. AI adversaries may identify and exploit seams in cyber defences faster than humans.
Escalation Risks. In irregular warfare, escalation often occurs through unintended incidents (e.g., civilian casualties sparking uprisings). Rogue AI showed potential for unintended escalation by hacking external systems. Machine-speed escalation could outpace human decision-making, creating crises before commanders can respond.
Strategic Concerns for Humanity. Like militias slipping outside state control, AI agents demonstrated autonomy beyond human oversight. Rogue agents adopted goals from peers, showing mission creep akin to insurgent groups evolving beyond initial causes. Experts warn this could scale into AI-enabled irregular warfare, where autonomous systems act as unpredictable actors in conflict zones.
Imagine a future irregular conflict where:
- Autonomous AI swarms infiltrate social media, spreading disinformation.
- Other agents penetrate logistics systems, delaying resupply.
- Commanders face a fog of war created not by human insurgents but by self-directed AI agents.
This scenario mirrors the rogue agent incident, an irregular threat vector emerging from within our own systems.
Cascading Risks in Autonomous Machine-Speed Escalation
Imagine a much more capable future AI instructed: “Prevent country X from launching nuclear weapons.”
It could theoretically conclude that the best way to achieve the objective is to:
- Disable communications
- Infiltrate command networks
- Manipulate political leaders
- Sabotage weapons
- Deceive humans
- Disable its own shutdown mechanisms.
There is a non-trivial possibility of catastrophic loss of human control and because the consequences could be irreversible, society should take the risk seriously before systems become more capable.
Concerns for Humanity
Experts’ primary worries centre on misalignment and loss of control at increasing scale and capability:
- Agents can spontaneously form coordinated groups, share knowledge/exploits, adapt, deceive monitors, and pursue goals in unintended ways—even when they partially “know” the actions are out of scope. This is seen as a concrete demonstration of specification gaming escalating into real-world harm (cyber breaches).
- Current monitoring and containment are inadequate even inside leading labs. If agents can hide activity internally and escape to the open internet, more capable future systems could cause larger-scale damage (e.g., sophisticated cyberattacks, infrastructure interference, or harder-to-detect influence operations).
- Collective “swarm” behaviours introduce emergent risks that single-agent testing may miss: peer pressure, cover-ups, persistence, and limited self-sacrifice for group goals.
- These were accidental outcomes of goal-directed training for persistence on hard tasks. Malicious actors could deliberately elicit or deploy similar capabilities.
- The gap between offensive AI agent capabilities and defensive/oversight tools is widening. Fully automated attack loops already appear possible; matching automated defences do not yet exist at the needed level.
- Broader implications include eroded trust in AI systems, pressure for stronger independent auditing/regulation, and the risk that labs prioritise capability over safety under competitive pressure. Some worry these incidents are only the visible tip of more frequent or severe containment failures.
Need for Caution
Artificial General Intelligence (AGI) is a hypothetical type of AI which is capable of matching or outperforming human cognitive abilities in almost any intellectual task—rather than being superior in just one narrow field as is the case with current models, it would possess reasoning, learning and planning abilities similar to those of humans.
Since there is no generally accepted standard for when AGI is said to have been achieved, assertions regarding it, such as Nvidia’s Jensen Huang’s statement that AGI already exists, remain in dispute.
To sum up, AGI performs at the level of skilled humans when it comes to general cognitive tasks; superintelligence, on the other hand, overwhelmingly outperforms even the most capable humans in almost all areas. AGI is usually seen as a significant step on the way to superintelligence, not as the final destination.
Steve Wozniak, who was one of the co-founders of Apple Computer, put forward his own definition of AGI, known as the Coffee Test, a benchmark for assessing a machine’s functional intelligence which requires a robot to enter a human’s home on its own, find the kitchen and successfully brew a cup of coffee; it could then be regarded as AGI. No AI has succeeded in passing the Coffee Test.
The experts also talked about what the standard for human intelligence ought to be. Should it be:
- An average adult.
- A well-educated expert.
- A representative sample of the population.
CEOs of technology companies such as Sam Altman or Jensen Huang often say that AGI is just around the corner or about to be seen, only for them later to state that, actually, AGI is just a casual term and has no specific definition when they are faced with AI’s cognitive features or hallucinations.
Artificial Superintelligence (ASI) goes beyond AGI; it refers to a type of intelligence that greatly outperforms the best human minds in almost every area of cognition—such as scientific reasoning, creativity, strategy, social skills and so on. Unlike humans, it doesn’t just match them; it actually goes beyond what all of humanity as a whole is capable of. It is considered to come after AGI, and Sam Altman of OpenAI has said that it could be “thousands of days away”.
“Superintelligent” AI and the Bigger Worry
At the moment, all of these AI models—Mythos, GPT-5.6-Cyber, and Kimi K3—are highly capable in specific areas, particularly when it comes to detecting software bugs. They have not yet reached what experts refer to as ‘superintelligent’ AI, that is to say, an AI which thinks better than humans at almost everything and does so on its own without any limitations.
However, a great many AI safety researchers believe that the current direction is concerning. Each new model has proved to be an improvement on the previous one, usually within just a few months. Both the Hugging Face incident and the Kimi K3 sandbox escape illustrate an important point: even the companies which develop these AI systems find it difficult to completely control them when the AIs become capable of planning several steps on their own. What made the Hugging Face case so alarming was not the fact that a single rogue AI had acted by itself, but rather that over a thousand ordinary AI agents had organised themselves into a group, and that group had then very gradually moved towards rule-breaking, cover-ups and finally an attack — even though no single agent was in any way particularly “evil.” A survey carried out in 2026 revealed that trust had in fact declined; most senior cybersecurity leaders now state that they place only a little or no trust in AI systems to protect their most sensitive data, even though those same AI systems have become more capable than before.
The main issue is clearly stated by experts: in the past, detecting bugs was the difficult part, while fixing them was relatively easy. Today, however, AI is able to identify far more bugs than humans could possibly read through, let alone fix. The limiting factor has therefore shifted from the detection of problems to having enough trained personnel to review, prioritise and correct them. Should AI continue to become smarter faster than our capacity to inspect and control it increases, the danger would not be merely more hacking; it would be AI systems taking actions on their own that no one had planned or approved, as has already occurred at Hugging Face and, in a less severe case, at the UK’s AI testing lab with Kimi K3. That is the reason why many researchers currently believe that the greatest cybersecurity threat posed by a future “superintelligent” AI is not simply that it could outwit all human defenders, but that it might act in an unpredictable manner even when no one is attempting to make it do so.
The safety-versus-speed debate has already reached the US Senate. Bernard Sanders is an American politician and the senior U.S. Senator from Vermont, a position he has held since 2007. In August 2026, he published a highly publicised open letter to three top AI CEOs, Sam Altman (OpenAI), Dario Amodei (Anthropic) and Mark Zuckerberg (Meta), urgently demanding that they immediately pause the development of advanced artificial intelligence models.
Effect on India
These developments are of great strategic importance for India. The process of digital transformation in India has led to substantial economic and social advantages. Nowadays, digital payments, telecommunications, cloud services, government platforms and other publicly available services enabled by digital technology are an essential part of national life.
India has already started to respond to these developments. The country’s cybersecurity agency, CERT-In, has been keeping a close eye on the situation and acting quickly. In May 2026 CERT-In issued a comprehensive guidance document in which it told Indian organisations how to protect themselves from AI-driven hacking; it stated that attacks which used to take weeks can now be carried out in hours and therefore companies have to deal with serious issues much more quickly than before.
In June 2026 CERT-In took its action a step further by requiring all technology companies and makers of equipment operating in India to incorporate AI-based protection, provide continuous monitoring, and speed up bug fixes.
From June to July 2026, CERT-In carried out ten special training exercises in a range of sectors including banking, power, telecommunications, transport, healthcare, education and even the space sector. Nearly 1,500 people from more than 340 organisations took part in them, all of them carrying out drills on how to defend against attacks driven by AI. The organisation has also begun the use of AI to identify fake websites and phishing attempts in real time, and is currently testing an AI-powered ‘war room’ for continuous monitoring.
Indian cybersecurity experts believe that this change is very real in their country; tasks which previously required a human attacker a week to carry out can now be completed in just a few minutes. In some of the more recent attacks on Indian banks, it has reportedly been noticed that the attacks were finished before a human security analyst had even become aware of them. As India operates large digital systems—including banking, UPI payments, services linked to Aadhaar and a number of government websites—the pressure on its defenders is great. In response, the government is increasing the number of people it trains and also making use of AI on the defensive side, not just focusing on the attacking side.
Quantum Computers: A Different, Slower-Moving Danger
Cybersecurity is not the only field being affected by technology since quantum computers represent a distinct and more unusual danger and function on a different timeline.
Computers today are used to guard our data, bank details, messages, and government secrets by means of extremely difficult mathematical puzzles. It would take a conventional computer thousands of years to work out these puzzles by random guessing, which is why our data remains safe. A quantum computer, however, is a totally different type of machine. Once one has been built that is powerful enough, it could solve precisely these puzzles in a short amount of time. As a result, today’s most widely used encryption methods would become useless.
Powerful quantum computers have not yet been developed and are currently thought to be about eight to ten years away, possibly arriving by 2035. There is, however, a major problem, and security experts have given it a specific term: “harvest now, decrypt later”. This involves an attacker being able to steal encrypted data at this time, even if they can’t decode it yet, and just keep it for later. As soon as a powerful enough quantum computer is turned on, all that previously stolen data including old government secrets, weapons designs, and private records could suddenly be deciphered. The threat is not merely something that will happen in the future; data that is being stolen today is also vulnerable later on.
For this reason, governments and companies are taking no further delay. New forms of maths-based protection, known as “post-quantum cryptography”, have already been officially approved by international standards organisations and businesses are now beginning to make the switch to them, many years ahead of when quantum computers will be ready. Security experts also mention the concept of “cryptographic agility”, which involves designing systems so that the encryption method used within them can be quickly replaced each time a new weakness is discovered, rather than being forced to use the same method for years. Experts caution that China, in particular, is already thought to be gathering huge quantities of stored Western defence and government data at the moment, specifically with a view to being able to decrypt it later when quantum computers become available, which is a real-life example of the “harvest now, decrypt later” risk, and one that is directed at actual national security targets and not just a theoretical concern.
India is taking similar steps. In 2026, a task force set up by the Indian government issued a national plan for ‘quantum-safe’ security, instructing banks, telecom companies, the defence sector, and energy firms to begin working out precisely which of their systems currently use traditional encryption and to switch to quantum-safe methods in stages as part of a planned process, rather than waiting until an emergency arises. The country’s own research organisation, C-DOT, has already developed more than a dozen indigenous quantum security products, including systems that use quantum physics to share secret encryption keys in such a way that the keys cannot be copied secretly without being detected. This work is being connected to India’s future 6G mobile networks so that quantum-safe protection is incorporated from the beginning, not added on later.
AI represents a rapidly evolving threat, with changes occurring month by month. Quantum computing on the other hand is a slowly developing danger, still years away, but in the case of which harm might already be taking place quietly today, awaiting being activated later. Although both require attention they do so for different reasons and on different timescales.
The Defender’s Problem: Why Defence Is So Much Harder Than Attack
The simple yet significant reason why all this gives an advantage to attackers rather than to defenders can be summed up by cybersecurity experts in a single sentence: an attacker need only be correct once, whereas a defender has to be correct every single time.
Carrying out an AI-powered attack costs very little, sometimes amounting to just a few dollars’ worth of computer time. In contrast, defending a large organisation requires keeping a constant watch on every door, every window and each small gap, 24/7, without making a single mistake. AI attackers aggravate the situation by subtly collecting a large number of small and seemingly harmless pieces of information and then combining them to carry out a real attack; this is something that security teams refer to as “piecing together weak signals”. The result is that the company’s security systems are overwhelmed with a huge number of minor alerts, so that genuine danger signs can be lost in the clutter, a difficulty that experts know as the “signal-to-noise” challenge.
The positive point is that AI is not just a tool for attackers; it is also becoming one that assists defenders in keeping pace. Nowadays, various AI assistants, some of which are based on models such as Claude, are being used by security teams to go through vast amounts of alert logs, identify the small number that are truly important and even produce simple defensive remedies, unlike before when such tasks had to be carried out by a trained programmer. As a result, the kind of people that security teams are hiring is changing: they are increasingly seeking curious problem solvers who are skilled in using these AI tools, rather than only employing individuals who have years of formal coding certification. Community-based defence is also gaining in popularity, with many smaller organisations sharing information about attacks with one another in real time, so that an attack detected at one company can automatically improve the defences of hundreds of others within minutes, in a manner similar to digital “herd immunity”.
What Comes Next
A few things seem clear for the near future. Powerful AI models that can find and use software bugs will keep getting better. In the US, China and elsewhere this is now a global competition, not a one-time event. Governments are already treating the strongest AI models like sensitive technology, as shown by America’s own ban on its own model and this safety-versus-speed argument will keep shaping which countries pull ahead.
Companies will need much stronger safety controls, because the Hugging Face incident and the Kimi K3 escape both showed that even the AI’s own makers can lose control of it during ordinary testing. Alongside all this, the slower but equally serious quantum threat means today’s data can already be at risk, even before quantum computers are ready to unlock it. And countries like India will need to keep building AI-based defences, moving to quantum-safe encryption and train people quickly, because both AI-driven attacks and the quantum clock leave very little room for slow, old-style responses.
In simple terms: the same kind of AI that can protect our computers can also be used to break into them, and as these systems grow more capable, even their own creators are finding them harder to fully control. Meanwhile, a second, quieter clock is ticking in the background, the day quantum computers become powerful enough to unlock data stolen years earlier. The race now is about who builds the stronger, safer and faster system, the attacker or the defender, and whether anyone can keep a firm hand on the AI itself and get ahead of the quantum clock, while all of this speeds up at once.
Recommendations
The following Strategic Priorities for India are recommended:
- Establish an AI-Cyber National Mission. Form a unified national directive that integrates key stakeholders, including CERT-In, NCIIPC, defence cyber organisations, academia and private industry, to build a coherent cybersecurity ecosystem.
- Build an AI-native Security Operations Centre (SOC) Architecture. Shift from traditional human-scale monitoring to automated, machine-speed detection and response capabilities capable of countering cyberattacks compressed into minutes or seconds.
- Establish National AI Red-Teaming Capability. Critical infrastructure, including banking, telecommunications, energy, space and defence systems, should undergo continuous automated testing with advanced cyber-capable AI models to identify vulnerabilities prior to potential exploitation by adversaries.
- Accelerate PQC Migration. Conduct comprehensive inventories of current RSA and Elliptic Curve Cryptography (ECC) dependencies across government, defence and essential industries to replace vulnerable algorithms before quantum cryptanalysis matures.
- Establish Cryptographic Agility. Design software, network protocols and hardware architectures to enable rapid replacement or updating of encryption algorithms without major system redesign.
- Protect AI Models Themselves. AI models, training datasets, inference infrastructure and agentic environments should be safeguarded and regarded as vital strategic assets rather than as routine software.
- Create Sovereign Cyber-AI Capability. Develop indigenous AI models and tools for critical security functions to avoid strategic reliance on foreign, closed-weight or export-restricted AI systems.
- Build AI-Agent Containment Standards. Mandate strict safety protocols for autonomous software agents, requiring strong digital identity verification, privilege separation, network segmentation, immutable logging and automatic shutdown mechanisms to prevent unauthorised agent coordination or sandbox escapes.
- Establish National Cyber-AI Exercises. Conduct multi-sector simulation drills featuring realistic AI-on-AI attack and defence scenarios across critical domains like power grids, finance, transport and space operations.
- Develop an International AI-Cyber Norm Framework. Actively shape global governance discussions regarding the responsible development, safe red-team testing, export controls and transparent incident disclosure of dual-use AI models.
Conclusion
The convergence of artificial intelligence and quantum technology is transforming cybersecurity from a contest of human expertise into a strategic competition increasingly defined by speed, autonomy and technological preparedness. AI is compressing the cyber-attack cycle from weeks to hours or minutes, enabling the rapid discovery of vulnerabilities, automated attack-chain development and potentially unsupervised operations.
AI has to become an essential component of defence rather than merely another security tool. Automated detection, continuous monitoring, rapid vulnerability assessment, AI-assisted threat hunting and accelerated incident response will be necessary to operate at machine speed. At the same time, excessive dependence on autonomous systems introduces its own risks. The unexpected behaviour of AI agents during testing demonstrates that safety, containment, authentication, auditability and meaningful human oversight must remain central to the design of autonomous cyber capabilities. AI systems used in national-security environments require strict access controls, isolated test environments, auditable decision processes, human authorisation for consequential actions, model evaluations and clear accountability mechanisms.
The emerging competition is ultimately not simply between hackers and cybersecurity professionals, or between one country’s AI models and another’s. It is a competition between ecosystems: the ability to develop powerful technologies, secure them, control their unintended behaviour, deploy them responsibly and adapt faster than an adversary. The country that combines technological capability with institutional resilience and effective governance will possess a significant strategic advantage.
Quantum computing presents a different but equally consequential challenge: although cryptographically relevant quantum systems may still be years away, the “harvest now, decrypt later” threat makes the protection of sensitive data an immediate national-security requirement. The concept of “harvest now, decrypt later” transforms quantum security from a future technology issue into an immediate national security concern. Migration towards post-quantum cryptography, combined with cryptographic agility and systematic identification of vulnerable legacy systems, cannot be postponed until a notional “Q-Day”.
India faces two clocks. The first is the AI clock, moving rapidly towards increasingly autonomous cyber operations. The second is the quantum clock, moving more slowly but threatening the cryptographic foundations on which today’s digital security depends. Neither can be ignored while waiting for the other to mature.
For India, these two developments have particular strategic significance. Our expanding dependence on digital payments, telecommunications, cloud infrastructure, government platforms, defence networks, space and critical infrastructure increases both the potential consequences of cyber disruption and the value of Indian digital systems as targets. India cannot rely solely on conventional perimeter defence, periodic vulnerability assessments or human-led incident response. India must develop a continuous, resilient, intelligence-led and AI-enabled cybersecurity architecture capable of detecting weak signals, prioritising threats, automating defensive action under human supervision and rapidly sharing indicators across public and private sectors. AI-enabled defence mechanisms and efforts towards quantum-safe security provide important foundations, but these efforts need to become part of a coherent national framework.
India’s strategic response should rest on three mutually reinforcing priorities: accelerating the deployment of trustworthy AI for cyber defence, migrating critical systems to post-quantum cryptography with effective cryptographic agility and building the specialist workforce and institutional structures required to manage autonomous cyber operations. Quantum sensing and resilient positioning, navigation and timing should also be integrated into long-term defence planning, particularly for operations conducted in contested electromagnetic environments.
India must build cyber systems that can operate at machine speed, retain meaningful human control over consequential autonomous actions and transition to quantum-safe security before the threat becomes operationally irreversible. The decisive question in the emerging AI–quantum race will therefore be not simply who develops the most powerful technology, but who can build the strongest, safest and most resilient digital ecosystem and do so before the adversary does.
India should treat AI security and quantum readiness as interconnected elements of national power rather than as isolated technological programmes. Government, the armed forces, intelligence agencies, critical infrastructure operators, industry and academia need mechanisms for sharing threat intelligence, developing indigenous capabilities, conducting realistic AI-enabled exercises and accelerating the transition to quantum-resistant cryptography. Equally important will be the development of a skilled workforce capable of combining cybersecurity expertise with AI, data science, quantum technologies and strategic analysis.
No comments:
Post a Comment