English translation is being prepared.

English translation is being prepared.

View original

35B multimodal AI. Running locally on an iPhone. Now at over 20 tokens/sec. 🚀 MiniCPM-V 4.7 achieves 20.51 tokens/sec average decoding speed on iPhone 18 Pro Max (12GB) — a 6.07× speedup over the same device’s unoptimized SSD expert-loading baseline. ⚡ Behind the speed: Lookahead Expert Scheduling (LES), optimized expert loading, fine-grained quantization, and DSpark speculative decoding. 📱 Watch the new on-device demo below. Powerful multimodal AI, right in your pocket. Try it 👇 🔗 GitHub: https://t.co/msjm2QkTGp 🤗 Hugging Face: https://t.co/W95QKGh0wY LES: https://t.co/6Ul7qXBItU #MiniCPM #OpenBMB