Mistral AI releases small-scale device models 'Ministral 3B' and 'Ministral 8B'
AI startup Mistral AI has announced two small language models with less than 10 billion parameters: ' Ministral 3B ' and ' Ministral 8B '. Misrtal AI calls these two models collectively ' les Ministraux '.
Un Ministral, des Ministraux | Mistral AI | Frontier AI in your hands
Large-scale language models are large in size and require high specifications, making them unsuitable for local operation on mobile devices such as smartphones and laptops. Therefore, various AI companies are developing small-scale language models with around a few billion parameters.
Both Les Ministraux models announced this time are small language models with less than 10 billion parameters and are intended to run locally on the device. Both models support a context length of up to 128k, and Ministral 8B is designed to be faster and more memory efficient.
Mistral AI said of Les Ministraux, 'These models set new frontiers in knowledge, common sense, reasoning, function invocation and efficiency in models with under 10 billion parameters and can be used and tuned for a variety of uses, from orchestrating agent workflows to creating specialized task workers.'
Below are the benchmark scores comparing the two Les Ministraux models with Google's Gemma 2 2B , Llama 3.2 3B , Llama 3.1 8B , and Mistral 7B in multiple categories of performance.
Mistral AI claims that both the Ministral 3B and Ministral 8B models outperform other language models of the same size.
Below is a comparison of accuracy between Gemma 2 2B, Llama 3.2 3B, Llama 3.1 8B, Ministral 3B, Ministral 7B, and Mistral 8B.
Ministral 3B and Ministral 8B will be available for a fee from October 16, 2024, with Ministral 3B costing $0.04 (approximately ¥6) per million tokens and Ministral 8B costing $0.1 (approximately ¥15) per million tokens.
Additionally, the weights for the Ministral 8B Instruct model are available for research purposes and are published here:
mistralai/Ministral-8B-Instruct-2410 · Hugging Face
https://huggingface.co/mistralai/Ministral-8B-Instruct-2410
Related Posts:
in Software, Posted by log1i_yk