r/Qwen_AI•
niwang66

How to deploy Qwen3 0.6B/1.7B on Qualcomm-based smartphones? GPU/NPU support, frameworks, and KV cache inference?

Hi everyone,

I'm exploring how to deploy Qwen3 models (specifically the 0.6B and 1.7B variants) on smartphones powered by Qualcomm chips (e.g., Snapdragon series). I’m particularly interested in:

  • Which frameworks and toolchains are best suited for this (e.g., ONNX, TFLite, MindSpore Lite, Qualcomm’s AI Engine SDK)?
  • Can these phones leverage GPU or NPU (e.g., Hexagon DSP or Adreno GPU) for accelerating inference?
  • Is KV cache (key-value caching for transformer inference) supported in this deployment scenario for faster autoregressive decoding?

Posted Aug 7, 2025, 1:02 AM UTC

91
Loading comments…