AI / ML
Mistral Large 4: "Le Chonk"
Mistral has released the Mistral Large 4, a new version of their large language model that improves upon its predecessors in various areas. The model has 6.7 billion parameters, an increase of 1.7 billion compared to the previous version. This expansion in model size has led to improvements in few-shot learning and few-shot fine-tuning, with the model achieving state-of-the-art results on several benchmarks. The improvements were made possible by the addition of a new transformer architecture and a 50% increase in compute resources. The Mistral Large 4 model is available for download on the Mistral website, and researchers can experiment with it to explore its capabilities. The release of the model is expected to have significant implications for the field of natural language processing and may lead to advancements in various applications such as language translation, text generation, and conversational AI. The model's performance on benchmarks such as SuperGLUE and GLUE has also been reported, with the Mistral Large 4 achieving state-of-the-art results on several tasks. The increased model size and improved architecture are expected to make the Mistral Large 4 a valuable tool for researchers and developers working in the field of natural language processing.
Read the full article at mistral.ai →