VOOZH about

URL: https://thenewstack.io/kubernetes-1-31-arrives-with-new-support-for-ai-ml-networking/

⇱ Kubernetes 1.31 Arrives with New Support for AI/ML, Networking - The New Stack


TNS
SUBSCRIBE
Join our community of software engineering leaders and aspirational developers. Always stay in-the-know by getting the most important news and exclusive content delivered fresh to your inbox to learn more about at-scale software development.
REQUIRED
It seems that you've previously unsubscribed from our newsletter in the past. Click the button below to open the re-subscribe form in a new tab. When you're done, simply close that tab and continue with this form to complete your subscription.
The New Stack does not sell your information or share it with unaffiliated third parties. By continuing, you agree to our Terms of Use and Privacy Policy.
Welcome and thank you for joining The New Stack community!
Please answer a few simple questions to help us deliver the news and resources you are interested in.
REQUIRED
REQUIRED
REQUIRED
REQUIRED
REQUIRED
Great to meet you!
Tell us a bit about your job so we can cover the topics you find most relevant.
REQUIRED
REQUIRED
REQUIRED
REQUIRED
REQUIRED
Welcome!

We’re so glad you’re here. You can expect all the best TNS content to arrive Monday through Friday to keep you on top of the news and at the top of your game.

What’s next?

Check your inbox for a confirmation email where you can adjust your preferences and even join additional groups.

Follow TNS on your favorite social media networks.

Become a TNS follower on LinkedIn.

Check out the latest featured and trending stories while you wait for your first TNS newsletter.

PREV
1 of 2
NEXT
VOXPOP
As a JavaScript developer, what non-React tools do you use most often?
Angular
0%
Astro
0%
Svelte
0%
Vue.js
0%
Other
0%
I only use React
0%
I don't use JavaScript
0%
Thanks for your opinion! Subscribe below to get the final results, published exclusively in our TNS Update newsletter:
NEW! Try Stackie AI
From clobbered drafts to real-time sync
Apr 14th 2026 10:00am, by David Moore
TypeScript 6.0 RC arrives as a bridge to a faster future
Mar 14th 2026 9:00am, by Darryl K. Taft
Mastra empowers web devs to build AI agents in TypeScript
Jan 28th 2026 11:00am, by Loraine Lawson
2024-08-13 14:00:26
Kubernetes 1.31 Arrives with New Support for AI/ML, Networking
sponsor-microsoft,sponsored-topic,
Cloud Native Ecosystem / Kubernetes

Kubernetes 1.31 Arrives with New Support for AI/ML, Networking

This release, nicknamed "Eli," introduces Device Resource Assignment, which standardizes the process of accessing hardware accelerators.
Aug 13th, 2024 2:00pm by Chris J. Preimesberger
👁 Featued image for: Kubernetes 1.31 Arrives with New Support for AI/ML, Networking
Image: Kubernetes 1.31 logo, courtesy of the Cloud Native Computing Foundation.

Normally, a software release with a lot of version numbers in it isn’t what’s considered a “major” release. That’s known as a “point” release. The big ones are usually relegated to simple X.0 or XX.0 designations.

Well, don’t be fooled by overlooking Kubernetes’ v1.31.0, which became generally available today. Its release leader, Angelos Kolaitis, says he considers this a “major minor release,” and that it’s important enough to warrant more than cursory attention.

Kubernetes, also known as K8s and originally developed by Google, is an open source platform designed to automate the deployment, scaling and management of containerized applications. It has skyrocketed in popularity and production use in IT systems in the last decade.

This latest edition (Kubernetes churns out three versions a year on a disciplined schedule) represents significant advancements in support of AI/ML workload processing and in networking generally, Kolaitis said.

New Attributes of Kubernetes 1.31.0

For support of AI/ML workloads, v1.31.0 introduces a volume type for (OCI) images, which enables developers to easily change a large language model used in a workload by simply changing out its image. OCI images are now used as volume sources in Kubernetes, so changing models or model weights is simplified.

“Developers using one particular model now can just change some OCI elements in the same way that they already know how to change images – for deployments when you want to upgrade or when you want to try something new. This is a very familiar process,” Kolaitis said.

OCI (Open Container Initiative) refers to a set of open standards and specifications that govern the creation, distribution and execution of container images.

The new edition exposes information about hardware devices used by pods, such as GPUs, in a more standardized and efficient way. Finally, it provides initial support for the new Device Resource Assignment (DRA) feature, which helps standardize the process of accessing and managing hardware accelerators, such as GPUs.

In networking, v1.31.0 improves Kube-proxy, a critical network component responsible for service discovery and load balancing within a cluster, with a new nftables bucket, which helps address performance limitations. Buckets are used to implement rate limiting and traffic-shaping mechanisms in nftables. They help prevent network congestion, ensure fair bandwidth allocation and protect against potential attacks, such as denial of service (DoS).

The new edition also continues to streamline and stabilize its core networking components, providing more reliability and robustness without requiring changes from users, Kolaitis said.

What Does DRA Do?

The Device Resource Assignment (DRA) feature is an important step forward in standardizing the process of accessing hardware accelerators, Kolaitis said. DRA enables the allocation and management of hardware devices, such as GPUs, field-programmable gate arrays (FPGAs) or network interface cards (NICs), to specific pods much more efficiently.

Key data points about DRA:

  • Device plugins: Kubernetes DRA uses device plugins to interface with the underlying hardware and make devices discoverable by the cluster.
  • Resource management: Once devices are recognized, they become manageable resources within Kubernetes, similar to CPU or memory.
  • Pod assignment: Users can request specific devices or device quantities in their pod specifications, and Kubernetes’ scheduler attempts to place those pods on nodes with matching available devices.
  • Exclusive access: DRA ensures exclusive access to assigned devices, preventing multiple pods from contending for the same hardware resource.
  • Extended resource API: The extended resource API in Kubernetes enables the representation and allocation of these specialized hardware devices.

Other Improvements in Kubernetes 1.31

Other improvements in v1.31.0 include:

  • Kubernetes support for AppArmor is now GA.
  • Persistent Volume last phase transition time feature moved to GA in v1.31.
  • The nftables backend moves to beta in v1.31, behind a newly added feature gate.
  • Traffic distribution for Services moves to beta in v1.31 and is enabled by default.
  • New restrictions included on anonymous API access.

Go here to access the complete blog post detailing the v1.31.0 release.

Go here for the GitHub release notes.

Microsoft (Nasdaq “MSFT” @microsoft) enables digital transformation for the era of an intelligent cloud and an intelligent edge. Its mission is to empower every person and every organization on the planet to achieve more.
Learn More
The latest from Microsoft
TRENDING STORIES
Chris J. Preimesberger, a contributing writer/editor at several publications since June 2021, is former editor in chief of eWEEK. He was responsible for the publication's coverage for a decade (2011-2021). In his 16 years and more than 5,000 articles at...
Read more from Chris J. Preimesberger
SHARE THIS STORY
TRENDING STORIES
The Cloud Native Computing Foundation and Google are sponsors of The New Stack. 
SHARE THIS STORY
TRENDING STORIES
TNS DAILY NEWSLETTER Receive a free roundup of the most recent TNS articles in your inbox each day.
The New Stack does not sell your information or share it with unaffiliated third parties. By continuing, you agree to our Terms of Use and Privacy Policy.