Promptware, cloud security trends for 2026, and what the Xbox One hack means for cybersecurity
This episode of Security Intelligence explores the "Promptware" kill chain for AI attacks, moving beyond simple prompt injections. The discussion also covers evolving cloud attack trends targeting ecosystems over infrastructure, ransomware gangs "living off the land" with native tools, and the critical yet overlooked "rusting edge" of OT security.
From Prompt Injection to the “Promptware” Kill Chain
The current discourse on AI vulnerabilities focuses too narrowly on prompt injection. A paper by researchers including Bruce Schneier introduces Promptware, a model that reframes AI attacks within a classic seven-step kill chain. Prompt injection is not the end goal but the initial access technique. The full kill chain includes:
- Initial Access (via prompt injection)
- Privilege Escalation
- Reconnaissance
- Persistence
- Command and Control
- Lateral Movement
- Action on Objective
This model highlights that the entire environment an AI model can touch is part of the attack surface. Attackers can leverage both direct prompt injection (e.g., “forget all previous instructions”) and indirect injection, where malicious instructions are seeded in documents or data that the model consumes. This creates a significant challenge of scale, as a single compromise can propagate widely and autonomously.
Defensive Strategy: Assume Breach
The consensus is that prompt injection cannot be completely fixed at present. Therefore, the most effective defensive strategy is to assume initial access will occur and focus on breaking the kill chain at subsequent stages.
We need an in-depth defensive strategy that assumes initial access will occur and focuses on breaking the chain at subsequent steps.
A practical approach is to treat the AI model or agent as a potentially malicious insider threat. This requires a shift in threat modeling to secure the environment accordingly. Key defensive tactics include:
- Identity and Access Management (IAM): Treat agents as highly privileged accounts. Implement strict IAM controls to limit their permissions and capabilities, thereby containing the potential blast radius of a compromise.
- Logging and Telemetry: Develop new ways to log agent conversations and actions. Defenders need visibility into how agents are picking up and executing instructions to detect malicious activity.
- Limiting Lateral Movement: Secure the agent’s environment to prevent it from propagating, moving laterally, or misusing permissions granted by users or the system.
Cloud Security: From Infrastructure to Ecosystem Attacks
Threat actors are shifting their focus from attacking hardened cloud infrastructure to exploiting the broader cloud ecosystem. They target the interconnected “edges” of the cloud, including identities, APIs, third-party integrations, and administrative tools.
This approach is more efficient and scalable because it exploits the implicit trust that makes cloud environments convenient. Attackers would rather gain a “fake ID” (e.g., a compromised API token or credential) to achieve a successful authentication than try to breach a hardened service directly.
The defensive mindset must shift from viewing cloud security as an infrastructure problem to an ecosystem problem. This acknowledges that you don’t have control over every component in your environment. It requires:
- Accepting and managing supply chain risk from third-party services.
- Architecting defenses with the assumption that a critical, external component could fail or be compromised.
- Implementing Zero Trust principles and defense-in-depth across all layers.
Ransomware Attackers Are “Living Off the Land”
Ransomware gangs are increasingly abandoning flashy external tools like Cobalt Strike in favor of living-off-the-land techniques. They leverage built-in system utilities like PowerShell and other Windows tools to conduct reconnaissance, maintain persistence, and exfiltrate data.
This shift is driven by two main factors:
- Economics: A less lucrative ransomware market, with lower payment frequencies and amounts, pushes attackers toward lower-cost, more efficient methods.
- Evasion: Advanced EDR and detection technologies have become adept at flagging known malicious tools. Using native system executables allows attackers to blend in with normal administrative traffic, making detection significantly harder.
This trend complicates defense, as it becomes challenging to distinguish between legitimate and malicious uses of administrative tools. The future may see AI-accelerated ransomware, where agents are used to automate these living-off-the-land attacks using well-documented native tools.
The “Rusting Edge” of Cybersecurity
While the industry focuses on cutting-edge AI and quantum technologies, a significant threat lies in the “rusting edge”: the ancient Operational Technology (OT) systems and PLCs that underpin critical infrastructure.
The dirty secret of critical infrastructure and American manufacturing isn’t that we are behind on patching. It’s that we are running the backbone of our economy on systems where patching is physically impossible.
These systems often run on obsolete software like Windows 95 or custom DOS kernels, for which no patches exist. Organizations are forced to rely on an “eBay supply chain,” hunting for second-hand parts to keep these critical systems running. This is fundamentally a capital expenditure problem, as replacing functional, albeit ancient, infrastructure is prohibitively expensive until a major failure forces the issue.
The Xbox One Hack: A Lesson in Hardware Security
After 13 years, the Xbox One—once called Microsoft’s “most secure product”—was finally hacked. The method was not a software exploit but a sophisticated hardware attack involving carefully timed voltage manipulation to bypass security controls.
While the specific attack is unlikely to be replicated in typical enterprise environments, there are takeaways for security professionals:
- Hardware Security Maturity: The immense difficulty of the hack is a testament to how far hardware security has come.
- Threat Modeling is Key: The security posture of a consumer device (expected to be in an adversary’s physical possession) is fundamentally different from that of a server in a secure data center.
- Game Preservation: The hack has practical value for digital preservation, enabling future emulation of the console’s software.
- Learning from the Best: Defenders can study the security architecture of the Xbox One to understand what made it so resilient for over a decade.