Everything there is to find on tag: inference.
Nvidia is working on a chip for AI inferencing with Groq technology
In addition to GPUs that handle the lion's share of AI training, Nvidia wants to introduce a chip for running...
Tag: inference
Timeline
OpenAI swaps Nvidia for Cerebras with GPT-5.3-Codex-Spark
OpenAI releases GPT-5.3-Codex-Spark, a smaller AI encoding model that generates over 1,000 tokens per second ...
OpenAI seeks faster alternatives to Nvidia chips
OpenAI is dissatisfied with the speed of Nvidia's AI chips for inference tasks and has been looking for alter...
Inferencing startup Baseten valued at $5B after new funding round
US AI startup Baseten has raised $300 million in growth capital at a valuation of $5 billion. The investment ...
Nvidia Blackwell successor Rubin releases in 2026: significant performance boost
During CES, Nvidia unveiled the Rubin platform, a new generation of AI infrastructure comprising six chips. T...
Top story
Red Hat progresses AI offerings for accelerated implementation
Red Hat is making progress in expanding its enterprise AI offering. Thanks to validated third-party AI models...
Top story
Red Hat lays foundation for AI inferencing: Server and llm-d project
This year's annual Red Hat Summit is all about AI inferencing. The open-source company sees a major role for ...
Google introduces Ironwood TPU: new powerful AI inference chip
During Google Cloud Next in Las Vegas, Google unveiled its latest Tensor Processing Unit (TPU): Ironwood. Thi...
Rapt AI and AMD want to make AI workloads more efficient on Instinct GPUs
Rapt AI and AMD have announced a strategic partnership to optimize AI workloads on AMD Instinct GPUs. This al...
Nvidia about to acquire cloud startup Lepton AI
Nvidia is busy acquiring the young cloud startup Lepton AI. This would be the second acquisition in a short t...