Baseten releases decision model joey-1, with P50 latency of 20ms and $0.01 per million tokens
Baseten's Base Labs has released joey-1, a 2B decision model that directly outputs a single-token label and calibrated confidence, with a P50 end-to-end latency of 20ms, about 2.5 times faster than elephant-1 (49ms), at a price of $0.01 per million tokens, one-tenth that of mammoth-1. joey-1 is post-trained from Qwen3.5-2B and shares the same data recipe and API with elephant-1 and mammoth-1, so switching requires changing only one line. The model is now available on Baseten Model APIs, with zero data retention by default, and its weights are open-sourced on Hugging Face; Model APIs supports a 16k context window, while dedicated deployments can unlock a 262k context window and support fine-tuned weights.

- English text is being prepared.
- MarkTechPost
- Unite.AI
Why read thisThe original text provides joey-1's latency, pricing, and the division of labor among the three model tiers, so readers can judge whether decision-making tasks should switch to a smaller model.


