Jul 16, 2024Mistral AI team

Mistral AI has released Mathstral, a 7B parameter model specifically designed for math reasoning and scientific discovery. Based on Mistral 7B, this new model features a 32k context window and is available under the Apache 2.0 license. It achieves state-of-the-art performance for its size on benchmarks like MATH and MMLU, showing significant improvement in STEM subjects. The model weights are hosted on HuggingFace, and it can be adapted using Mistral's inference and fine-tuning tools.