LiteRT Runtime
API and Platform updates
Rust Integration - Published google-ai-edge-litert crate on crates.io enabling C++ SDK capabilities in Rust
ABI Compatibility - Added ABI version tracking to key modules (libLiteRT.so, GPU accelerator, Dispatch, Compiler) facilitating smoother upgrades across 2.2.x binary versions.
API Updates
LiteRT.js - LiteRT Tensor API support and features for recurrent KV cache swapping; and JIT/tracing support for custom tensor graphs.
New Data Type - Added native support for F8E4M3FN and F8E5M2 tensor elements
New HW support
Intel NPU - Added full JIT/AOT support for LunarLake and Panther Lake
Qualcomm - QAIRT : Improved SoC coverage with SDK 2.47
MediaTek - Improvements to channelwise quantization support
CPU (Experimental) : New YNNPack accelerator
Performance and Model optimizations
LLM throughput improvements - added ROPE composite Ops for GPU, resulting in ~5% faster decode performance
Multiple optimizations for memory efficiency and GPU execution
Validation / Testing Infrastructure
Faster test registration
New multi-criteria validation framework (ConformanceSpec) for mixed-precision verification.