Everything there is to find on tag: llm-d.
llm-d 1.0 makes distributed AI inference production-ready
The open-source llm-d project has reached version 1.0. The release focuses on the day-to-day management of AI...
Tag: llm-d
Timeline
Red Hat AI 3.5 focuses on governance and shared GPUs
Red Hat AI 3.5 centers on pre-deployment security verification, multi-tenancy on shared GPU infrastructure, a...
Top story
Chris Wright: Metal-to-agent is the foundation of scalable enterprise AI
Red Hat is adapting its platform strategy to the changing enterprise AI market. The exploding token consumpti...
llm-d joins the CNCF
llm-d has been officially accepted as a CNCF Sandbox project. This places the project under the Linux Foundat...