
Meta debuts its first 'mixture of experts' models from the Llama 4 herd
Meta has debuted the first two models in its Llama 4 family, its first to use mixture of experts tech. A Saturday post from the social media giant announced the release of two models: Llama 4 Scout, which has 17 billion active parameter model with 16 …