Who Is Checking the AI’s Work?

Jul 20, 2026

Reading Time: 4 minutes

Who’s Checking the AI’s Work? Mitigating Vibe-Coding Security Risks

Cyber Security • AI Development • Software Supply Chain • Risk Governance

Strategic Summary: Generative AI has dramatically accelerated software development, but it has introduced a dangerous operational assumption: that functional code is inherently secure code. In this strategic brief, CEO Geordie Hogarth explores the emerging security vulnerabilities of “vibe-coded” software, supply-chain exposures, and how Si Futures uses independent AI-assisted penetration testing to validate infrastructure before threats impact clients.

There is a version of AI-assisted development that goes something like this: a developer describes what they need, the AI writes the code, the developer tests that it works, and then publishes it. It loads. It responds. Hello World. Ship it. The problem is that “it works” and “it is secure” are two entirely different questions. Most of the time, only the first one gets asked.

The Vibe-Coding Risk Nobody Is Talking About

A term has emerged in development circles for code produced quickly, largely with AI, and without deep scrutiny of what was actually generated: vibe-coded.

The developer trusts the output, tests its surface behaviour, and moves on. This is not necessarily reckless. AI coding tools are genuinely impressive and can significantly accelerate development. But they also drastically increase the volume and speed at which unfamiliar code is introduced into an enterprise application.

The risk itself is not entirely new. Engineers have always worked with third-party libraries, inherited legacy systems, and code they did not write themselves. AI-assisted development, however, creates greater distance between the person approving the output and the logic actually being deployed.

It is entirely possible to publish an application that functions perfectly for its intended purpose while simultaneously:

  • Exposing software version metadata to external reconnaissance tools.
  • Introducing broken access control (BAC) vulnerabilities.
  • Leaving administrative interfaces publicly accessible to the internet.
  • Allowing unauthorised cross-tenant data access across multi-client environments.

The developer did not introduce those vulnerabilities intentionally. The rapid development pipeline did not flag them as risks. And because the application worked when tested, nobody thought to look further.

What We Found When We Checked Our Own Work

To rigorously evaluate this threat vector, we recently set up a isolated Kali Linux environment in AWS, connected it to Claude, and ran automated penetration tests against our own internet-facing services.

Claude was given a strictly defined scope, an approved suite of Kali Linux testing tools, and a structured brief. Under the active supervision of our security engineers, it executed continuous security-testing playbooks against our applications.

What came back was not catastrophic, but it was deeply instructive.

One of our secondary platforms was actively exposing version information. It was not revealing internal database assets, but it was leaking enough metadata for a sophisticated adversary to identify the precise software build and cross-reference it against known Common Vulnerabilities and Exposures (CVE) databases.

The remediation took less than an hour. Had we not proactively looked, however, we would have had no way of knowing the exposure existed. The lesson is not that our applications were dangerously insecure—the lesson is that, without an independent check, no organization can reliably prove its security posture.

This is the core principle behind managed cybersecurity done properly: not assuming that an environment is safe because nothing has visibly broken, but actively searching for what hasn’t been found yet.

The Software Supply-Chain Dimension

This is not merely an internal development problem. Enterprise security teams are simultaneously fighting escalating software supply-chain risks. Malicious or compromised software packages can be distributed through public repositories such as npm and GitHub, then pulled into corporate dev environments by engineers who have no immediate reason to distrust them.

The code installs. It compiles. It executes cleanly. Yet somewhere buried deep inside the dependency tree, an unverified package may be executing unauthorised background actions.

AI-assisted development amplifies this exposure vector by accelerating package selection, snippet generation, and library integration—especially when AI recommendations are accepted without manual code audits. The common thread in all these scenarios remains identical: someone assumed that because something worked, it was safe.

That assumption becomes exponentially more dangerous as AI accelerates the pace at which code is written, integrated, published, and deployed.

“The speed of AI-assisted development is real. So is the risk that comes with skipping the validation step that used to slow things down.”

Building Independent Checks Into Your Process

At Si Futures, our operational policy is to run AI-assisted penetration tests against our internet-facing infrastructure as a standing practice. This is not a static, one-off audit. It is a continuous methodology where high-risk assets are prioritised, testing scopes are formally authorized, findings are triaged by our senior engineers, and vulnerabilities are closed before they can affect client operations.

We also enforce an AI-assisted peer-review workflow across our internal development platform. Pull requests are independently scanned for architectural flaws before being merged, while final remediation choices remain firmly in the hands of our human developers.

The rule governing both practices is the exact same one we enforce for client networks: You cannot rely on the person, team, or system that built something to be the only entity checking whether it is secure.

If your organization is leveraging AI to build software or accelerate operational workflows—whether internally or through external development partners—the vital question for IT leaders is not merely whether the application functions.

It is who is auditing the work the AI produced, what parameters they are checking it for, and how frequently that validation occurs.

Validation Checklist for IT Directors and CTOs

To maintain operational resilience in an AI-accelerated development landscape, ensure your team enforces three non-negotiables:

  • Independent Code Reviews: Require that all AI-generated code snippets undergo secondary review for logic flaws and version exposure prior to staging deployment.
  • Continuous Automated Pentesting: Treat every public endpoint as a dynamic asset requiring scheduled vulnerability probing, rather than relying on annual audits.
  • The Trusted Response Mechanism: Ensure security logs and AI scan flags feed directly into active engineering teams backed by an operational IT Support and Operations framework.
The engineers applying this rigorous security discipline to our own cloud infrastructure are the exact same specialists monitoring and defending our clients’ business environments around the clock through the Si Futures Trusted Response Centre.Do not let rapid AI deployment silently compromise your corporate security perimeter. Establish independent checks across your digital assets today.

Who Is Auditing Your AI-Assisted Deployments?

Eliminate hidden software vulnerabilities and secure your internet-facing assets against supply-chain risks. Connect with our senior cybersecurity team today to schedule an independent security review and automated penetration audit.

SPEAK TO OUR CYBERSECURITY TEAM

author avatar
Nicholas Broderick

Let’s connect