Lightbits set to release KV cache engine to boost GPU performance

SiliconANGLESeptember 9, 2026en

Lightbits Labs Ltd. today announced the general availability of Inferra, a software engine designed to improve the economics and performance of artificial intelligence inference by moving key-value cache data beyond the limited high-bandwidth memory attached to graphics processing units. The company, best known as the inventor of the NVMe over TCP storage protocol, is positioning […] The post Lightbits set to release KV cache engine to boost GPU performance appeared first on SiliconANGLE .

This is a short summary published by AI Global Wire. The full article is owned and hosted by SiliconANGLE — open it there to read it in full.

• Verktyg