0

title: "Mistral 7B"

https://mistral.ai/it/news/announcing-mistral-7b/(mistral.ai)
Mistral 7B is a powerful 7.3 billion parameter language model that outperforms the much larger Llama 2 13B across all major benchmarks. It achieves impressive efficiency using Grouped-query attention for faster inference and Sliding Window Attention to handle longer text sequences at a lower cost. While excelling at English tasks, the model also demonstrates strong capabilities in coding, nearly matching the performance of specialized code models. Released under the permissive Apache 2.0 license, Mistral 7B is freely available for anyone to download, customize, and deploy without restrictions.
0 pointsby chrisf1 hour ago

Comments (0)

No comments yet. Be the first to comment!

Want to join the discussion?