0

Granite Switch 4.1: Chat, Decisions, and Speech from One Endpoint

https://huggingface.co/blog/ibm-granite/granite-switch-4-1(huggingface.co)
Granite Switch 4.1 introduces a modular AI model that integrates chat, decision-making, and speech-to-text functions into a single endpoint. The new models are configured with a general Decision aLoRA, a specialized Guardian aLoRA for safety tasks, and an embedded automatic speech recognition (ASR) model. This architecture utilizes cache-efficient Activated LoRAs (aLoRA) to reuse the base model's KV cache, enabling rapid switching between tasks while minimizing VRAM usage. The framework is extensible, allowing users to compose their own models by combining various adapters from the Granite Libraries to suit specific needs.
0 points•by hdt•1 hour ago

Comments (0)

No comments yet. Be the first to comment!

Have an account? Log in to join the discussion.