Thomas Wolf comments on Recursive's new model Flint: quantizing lm_head to 4 bits still comes close to bf16
Hugging Face co-founder Thomas Wolf said that his AGI standard remains AI winning a Nobel Prize, but the AI researchers at Recursive quantized lm_head—which is usually advised to be kept at high precision—to 4 bits, and the result differs from bf16 by only 0.7 percentage points, which impressed him. He also mentioned that the model was released as open weights on Hugging Face, and congratulated Recursive. The quoted original Recursive post introduced that Flint is its first model, positioned as a fast local coding model, built by the automated research system Eureka Machine, reaching 125+ tokens/sec on a MacBook Pro and 150+ on RTX Spark, and built from scratch in under 4 months.
Hugging Face co-founder Thomas Wolf said that his AGI standard remains AI winning a Nobel Prize, but the AI researchers at Recursive quantized lm head—which is usually advised to be kept at high precision—to 4 bits, and the result differs from bf16 by only 0.7 percentage points, which impressed him. He also mentioned that the model was released as open weights on Hugging Face, and congratulated Recursive. The quoted original Recursive post introduced that Flint is its first model, positioned as
Matched fieldsSummary