0
llama.cpp v1.0.0 : A stronger foundation for the local AI ecosystem
https://huggingface.co/blog/ggml-org/llama-cpp-v1(huggingface.co)The llama.cpp project has released version 1.0.0, aiming to provide a stronger foundation for the local AI ecosystem. This C/C++ library enables running multi-modal LLMs on a wide range of hardware through quantization, optimized backends, and a portable implementation. With this release, the project commits to API and ABI stability by adopting semantic versioning, where major version bumps will signify breaking changes. The underlying ggml engine supports numerous hardware backends, and llama.cpp itself is compatible with over 150 model architecture variants.
0 points•by hdt•50 minutes ago
Comments (0)
No comments yet. Be the first to comment!
Have an account? Log in to join the discussion.