NPU prefill
12,540tok/s
LFM 2.5 230M · Hexagon v81
QHexRT by RunAnywhere
Every modality, 100% on the Hexagon NPU.
(the CPU stays idle)
Same agentic kernel pipeline as MetalRT, pinned to Qualcomm silicon. Nothing falls back to the CPU.
How it works
One build per NPU generation.
Hexagon lets us decide exactly what runs where, so a model is built and pinned separately for v75, v79, and v81. An unsupported operation fails loudly at compile time, before it ever reaches a device.
TTFT
36ms
LFM 2.5 230M · Hexagon v81
NPU resident
100%
LLM live · other modalities in development
Validation
Checked against the chip, not a simulator.
Every shipped build is verified against the real NPU output, across many inputs and prompt lengths.
Publications