IBM Granite Switch 4.1.1 release notes

Overview of Granite Switch 4.1.1

Granite Switch 4.1.1 is a patch release designed to provide incremental improvements to the Granite Switch architecture while maintaining full backward compatibility with version 4.1. The update demonstrates the efficiency of the modular Switch architecture, which allows developers to swap specialized, cache-efficient adapters on a single endpoint without needing to recompute or retrain the underlying base model.

Key Technical Updates

This release focuses on two primary component upgrades:

  • Updated Granite Speech ASR Model: The new granite-speech-5.0-470m-turboctc model provides multilingual automatic speech recognition across 10 languages. It includes native support for punctuation and capitalization, enabling direct integration into downstream models without requiring a separate formatting pipeline.
  • Improved Decision Adapter: The granitelib-core-r1.0 has been updated with a new decision adapter, resulting in enhanced performance on the Jev Decision Index test set.

Modular Architecture and Future Development

The primary advantage of the Granite Switch architecture is the ability to treat model updates similarly to software updates. By decoupling the base model from specialized adapters, teams can iterate on specific capabilities and ship updates rapidly.

IBM is currently developing an Adapter SDK and accompanying tutorials to enable third-party developers and providers to create, test, and deploy their own custom adapters. This approach aims to standardize the lifecycle of model iteration, allowing for versioning and feature testing that mirrors traditional software development workflows.

Sources