Open-weight AI is changing the rules of product security

New research on Z.AI’s open-weight GLM-5.3 model is raising fresh questions about how quickly advanced cyber capabilities are spreading.

Open-weight models are making sophisticated attack capabilities more accessible, why provider safeguards become harder to enforce once models can be downloaded and modified. AI is already changing the way attackers find and exploit software vulnerabilities.

If you want a view of this, here’s one: https://www.businessworld.in/article/chinese-ai-model-executes-complex-cyberattacks-in-tests-631067

Willy Leichter, CMO, PointGuard AI

“This is a predictable next step: powerful attack capabilities becoming more accessible and easier to adapt. Open-weight models give operators more control, making provider safeguards harder to rely on. The biggest change is how quickly attackers can turn emerging capabilities into usable tools.

“AI reduces the expertise, time, and resources needed for sophisticated attacks. It doesn’t make every novice an expert, but it puts specialized capabilities within reach. The genie’s not going back in the bottle. Defenders must assume these tools are already available.

“Defenses must cover AI-enabled attacks and the broader AI attack surface: models, agents, endpoints, tool connections, identities, and data. Teams need continuous visibility, enforceable access controls, and rapid containment, powered by equally capable AI to keep pace with attackers.

“The cycle is familiar: new attack tools emerge and defenses evolve. What has changed dramatically is the timeline. Attackers can develop and execute attacks faster, leaving less time to respond. Intelligent defenses must match that speed and act before damage spreads.”

Matt Wyckhouse, CEO, Finite State

“Manufacturers can no longer rely on an AI provider’s safeguards to keep capable adversarial agents away from their firmware. They need to assume attackers have access to these capabilities and use the same advances to find and fix weaknesses first.

“These models could make it easier to exploit device software and third-party components, and firmware analysis is already showing what that looks like. Following the French refrigeration attacks, Finite State analyzed refrigeration-controller firmware using a blinded, binary-only agent workflow. Our agents independently rediscovered the disclosed vulnerabilities within hours. (See published findings here)


“Across our broader firmware work, we are routinely finding zero-day vulnerabilities and exploitable N-day vulnerabilities for pennies to dollars of compute. That is compute expenditure, not the total cost of engineering validation and remediation, but it represents a fundamental change in the economics of finding weaknesses.


“The tools around the models are advancing too. Open-source projects such as REA, Reverse Engineer Anything, connect AI agents to established reverse-engineering tools so they can inspect compiled software without its original source code. REA is not itself an autonomous vulnerability scanner, but it makes sophisticated analysis tools more accessible to agents and their operators.


“For manufacturers, this means attackers can often download firmware and investigate it offline. Shared libraries and supplier components can then carry the same weakness into many products. An attacker does not necessarily need a new vulnerability; an old vulnerability that remains exploitable in deployed firmware may be enough.

“Manufacturers should test their firmware the same way adversarial agents will: analyze the shipping binaries, investigate exposed interfaces and validate potential paths to compromise. They should do that regularly and continuously, rather than treating security testing as a one-time release gate.”

In short, your defences need to account for AI for starters. And they need to account for it evolving. Otherwise, I will be writing about you very soon once you’ve been pwned.

Leave a Reply