Everything there is to find on tag: mixture of experts.
JetBrains releases Mellum2 coding model
JetBrains has released Mellum2 as open source, a 12B-parameter model built for software engineering environme...
Tag: mixture of experts
Timeline
Meta launches Llama 4: new multimodal AI models
Meta has announced the first models in the Llama 4 series. The new multimodal AI models, Llama 4 Scout and Ll...
DeepSeek introduces series of LLMs with high reasoning capabilities
Chinese LLM developer DeepSeek has unveiled its R1 series of large language models (LLMs), optimized specific...
DeepSeek-V3 overcomes challenges of Mixture of Experts technique
Qualitative answers in an energy-efficient way
Microsoft has success with Mixture of Experts technique in Phi-3.5
Microsoft announces a new family of LMs. The Phi-3.5 line includes three models, including, for the first tim...
xAI open sources details and architecture of their Grok-1 LLM
Elon Musk's AI developer xAI has finally made the basic model, underlying parameters and architecture of the ...
Microsoft launches Tutel, an open-source library for AI development
Microsoft announces Tutel. The open-source library is available immediately for developing AI models and appl...