NVIDIA releases on-device small model Nemotron-3.5-Bolt-E4B
NVIDIA releases the on-device small model Nemotron-3.5-Bolt-E4B. A report on October 23, 2026 states that the model can run locally on devices with 6GB of memory, targeting on-device devices such as phones; it is trained based on Gemma 4, supports vision, and Unsloth simultaneously provides the GGUF file and a guide link. NVIDIA says it targets scenarios such as local assistants, interactive characters, and robots that can converse and call tools. A follow-up report on October 24 states that the model has 8B total parameters, 4B effective parameters, and a 64K context, and is post-trained using only reinforcement learning based on Google Gemma 4 E4B; the Q4_K_M version occupies 3.1 to 4.3 GB of VRAM on RTX and can run on GeForce RTX, Jetson, and DGX Spark. The report also states that in NVIDIA's own testing, it leads Gemma 4 E4B, Qwen3.5-4B, and Nemotron 3 Nano 4B in 15 of 21 benchmarks, but Tau2-Bench is 55.1, trailing Qwen3.5-4B's 75.1.
Matched fieldsTitle
View story:NVIDIA releases on-device small model Nemotron-3.5-Bolt-E4B