Qwen3.8-27B on the iPhone 18 Neural Engine at 15–70 tok/s (1.5 bpw)
A user on Twitter shared performance results for the Qwen3.8-27B model running on the iPhone 18's Neural Engine, achieving 15–70 tokens per second (1.5 billion parameters per second).
Read the full article at twitter.com →