Everything there is to find on tag: vLLM.
Red Hat OpenShift 4.20: AI, post-quantum, and broader VM support
Red Hat has released version 4.20 of OpenShift. The solution gets new AI tooling, post-quantum encryption, an...
Tag: vLLM
Timeline
Top story
Red Hat lays foundation for AI inferencing: Server and llm-d project
This year's annual Red Hat Summit is all about AI inferencing. The open-source company sees a major role for ...
Microsoft expands AKS with RAG functionality and vLLM support
During KubeCon, Microsoft announced that it supports Retrieval Augmented Generation (RAG) in KAITO on Azure K...