VOOZH about

URL: https://thenewstack.io/ai-security-needs-better-infrastructure-not-more-tools/

⇱ AI Security Needs Better Infrastructure, Not More Tools - The New Stack


TNS
SUBSCRIBE
Join our community of software engineering leaders and aspirational developers. Always stay in-the-know by getting the most important news and exclusive content delivered fresh to your inbox to learn more about at-scale software development.
REQUIRED
It seems that you've previously unsubscribed from our newsletter in the past. Click the button below to open the re-subscribe form in a new tab. When you're done, simply close that tab and continue with this form to complete your subscription.
The New Stack does not sell your information or share it with unaffiliated third parties. By continuing, you agree to our Terms of Use and Privacy Policy.
Welcome and thank you for joining The New Stack community!
Please answer a few simple questions to help us deliver the news and resources you are interested in.
REQUIRED
REQUIRED
REQUIRED
REQUIRED
REQUIRED
Great to meet you!
Tell us a bit about your job so we can cover the topics you find most relevant.
REQUIRED
REQUIRED
REQUIRED
REQUIRED
REQUIRED
Welcome!

We’re so glad you’re here. You can expect all the best TNS content to arrive Monday through Friday to keep you on top of the news and at the top of your game.

What’s next?

Check your inbox for a confirmation email where you can adjust your preferences and even join additional groups.

Follow TNS on your favorite social media networks.

Become a TNS follower on LinkedIn.

Check out the latest featured and trending stories while you wait for your first TNS newsletter.

PREV
1 of 2
NEXT
VOXPOP
As a JavaScript developer, what non-React tools do you use most often?
Angular
0%
Astro
0%
Svelte
0%
Vue.js
0%
Other
0%
I only use React
0%
I don't use JavaScript
0%
Thanks for your opinion! Subscribe below to get the final results, published exclusively in our TNS Update newsletter:
NEW! Try Stackie AI
From clobbered drafts to real-time sync
Apr 14th 2026 10:00am, by David Moore
TypeScript 6.0 RC arrives as a bridge to a faster future
Mar 14th 2026 9:00am, by Darryl K. Taft
Mastra empowers web devs to build AI agents in TypeScript
Jan 28th 2026 11:00am, by Loraine Lawson
2025-06-23 09:00:27
AI Security Needs Better Infrastructure, Not More Tools
sponsor-edera,sponsored-post-contributed,
AI / Operations / Security

AI Security Needs Better Infrastructure, Not More Tools

A recent industry analysis reveals a major gap in AI infrastructure security between marketing hype and actual enterprise needs.
Jun 23rd, 2025 9:00am by Kaylin Trychon
👁 Featued image for: AI Security Needs Better Infrastructure, Not More Tools
Featured image from Roman Samborskyi on Shutterstock.
Edera sponsored this post.

The AI security market is having its “emperor has no clothes” moment. According to Latio’s Q2 2025 AI Security Market Report, 93% of security professionals recognize AI’s potential to enhance cybersecurity, but a staggering 77% of organizations feel unprepared to defend against AI-driven threats. More tellingly, when surveyed about their immediate AI security priorities, practitioners revealed a troubling disconnect between vendor messaging and real-world needs.

I’ve witnessed this disconnect firsthand through conversations with enterprise customers rushing to deploy AI workloads. The patterns mirror what we saw during container adoption — excitement trumping security, with painful lessons learned only after incidents occur.

The Great AI Security Misdirection

Most AI security vendors are solving yesterday’s problems while tomorrow’s threats are already materializing. The report reveals that the majority of AI security solutions started by focusing on employee data loss prevention (DLP), essentially building fancy monitoring tools to watch what employees paste into ChatGPT. Others focus on AI “firewalls” that filter inputs and outputs of LLMs, which are useful but limited in scope. Meanwhile, the real risk is rapidly shifting toward AI applications that can access sensitive data and take actions on behalf of users.

This misdirection isn’t accidental. DLP-style solutions are easier to build and tap into CISOs’ familiar fear patterns. But as Microsoft Copilot and Google‘s Gemini mature with built-in guardrails, these monitoring solutions are becoming commoditized.

The fundamental issue isn’t just about AI security tools; it’s about whether the underlying infrastructure can support secure AI workloads at scale. Many organizations are building AI applications on container foundations that were never designed for the isolation requirements that sensitive AI workloads demand.

Where Infrastructure Meets AI Security Risk

The report’s most crucial insight centers on “application runtime protection” — the security challenges that emerge when AI systems move beyond simple chatbots to become autonomous agents. Consider the risk evolution: A basic ChatGPT session carries minimal risk, but AI agents present entirely different threat landscapes. For example, AI coding assistants that can execute arbitrary code during development, or agents that query internal databases and trigger financial transactions. These scenarios demand infrastructure-level security controls.

Here’s where infrastructure decisions become critical. AI workloads processing sensitive data require the same kernel-level isolation that enterprises depend on for their most critical applications. The shared kernel model that many container-based AI deployments rely on creates attack vectors that simply can’t be adequately secured with application-layer protections alone.

According to Microsoft’s 2024 container security overview, container-based workloads face growing security threats, with security teams often unable to track which containers are running or vulnerable at any given time. For AI workloads handling sensitive data, these visibility gaps become critical vulnerabilities.

Infrastructure Requirements AI Workloads Actually Need

AI applications demand three infrastructure characteristics that traditional container deployments struggle to provide:

  • True isolation: AI models processing proprietary data need kernel-level separation, not just namespace isolation. When an AI system can access customer records or financial data, shared kernel vulnerabilities become business-critical risks.
  • Performance without compromise: AI inference workloads are latency-sensitive. The networking and I/O overhead inherent in many container architectures can make real-time AI applications unusable.
  • Dynamic resource allocation: Unlike traditional applications, AI workloads have highly variable resource needs. Infrastructure that can dynamically allocate GPU and memory resources based on actual demand eliminates the massive overprovisioning waste that plagues standard container deployments.

The Build vs. Buy vs. Wait Decision

The investment landscape tells a revealing story. While organizations are spending over $320 billion on AI infrastructure in 2025, the AI security market represents just $25 billion — a fraction focused on securing these massive infrastructure investments. This disparity highlights the gap between infrastructure spending and security preparation.

The answer to whether organizations should invest in dedicated AI security tools depends on your AI adoption velocity and infrastructure maturity. If you’re building AI applications that handle sensitive data, dedicated tools offer specialization that incumbents can’t match. But architecture decisions matter more than vendor selection. Organizations that build AI infrastructure with hypervisor-level isolation and secure multitenancy from the ground up have significant advantages over those trying to retrofit security into existing container deployments.

Traditional security vendors are rapidly adding AI capabilities, but they’re playing catch-up to solutions designed from the ground up for this threat landscape. The most effective approaches combine proven security principles, like hypervisor-based isolation, with modern implementations optimized for AI workload characteristics.

Looking Into the Crystal Ball

Based on the report’s findings, three trends are emerging:

First, DLP-focused AI security will consolidate rapidly as platforms build native protections. Second, runtime application protection will drive the majority of market growth, with infrastructure security becoming a key differentiator. Third, “security by design” versus “security as afterthought” will separate market leaders from followers.

What Organizations Should Do Now

The AI security market’s growing pains mirror past technology adoption cycles. Organizations that will thrive are those that focus on their actual risk profile and infrastructure foundation rather than chasing security trends.

Start by asking these questions: Where is AI actually deployed in your organization? What data can it access? Can your current infrastructure provide adequate isolation for these workloads? The answers should drive your AI security strategy, not vendor marketing.

Apply time-tested infrastructure principles while adapting to AI’s unique requirements. Those who build secure, efficient foundations will outperform those who bolt security onto inadequate infrastructure.

The emperor may not have clothes, but recognizing that reality is the first step toward building AI security that actually works.

Edera reimagines container runtime, bringing resource optimization to workloads without disrupting developer workflows. We’ve redesigned the core architecture: solving from the hardware up, not software down. Our approach bridges the gap between how containers ship and how they should run.
Learn More
The latest from Edera
TRENDING STORIES
Kaylin Trychon is chief marketing officer at Edera and a seasoned cybersecurity executive specializing in cloud native security, threat intelligence and Kubernetes development. Prior to joining Edera, she held leadership positions at Chainguard and Google.
Read more from Kaylin Trychon
Edera sponsored this post.
SHARE THIS STORY
TRENDING STORIES
SHARE THIS STORY
TRENDING STORIES
TNS DAILY NEWSLETTER Receive a free roundup of the most recent TNS articles in your inbox each day.
The New Stack does not sell your information or share it with unaffiliated third parties. By continuing, you agree to our Terms of Use and Privacy Policy.