Whileone Tech Space

Whileone has been making slow incremental changes to XNNPACK that makes the first convolution of common vision models 1.20–1.39x faster on AWS Graviton3, Graviton4 and Graviton5. Every other layer runs at the same speed. XNNPACK is the CPU engine under LiteRT (TensorFlow Lite), ExecuTorch and MediaPipe. A small win there reaches a very large number of devices. The problem: a kernel built for wide inputs On Arm CPUs with the I8MM extension, XNNPACK runs int8 convolutions throu