title: "Mistral 7B"

Mistral 7B is a 7.3 billion parameter language model that surpasses the performance of Llama 2 13B across all evaluated benchmarks. It also outperforms Llama 1 34B in many areas and shows strong coding abilities comparable to CodeLlama 7B. The model incorporates Grouped-Query Attention (GQA) for faster inference and Sliding Window Attention (SWA) to efficiently process longer sequences at a lower cost. Released under the Apache 2.0 license, Mistral 7B is freely available for unrestricted use and can be fine-tuned for various tasks.