Microsoft releases Decision-1.1, scoring 68 on the Decision Index
Microsoft releases the decision model Microsoft-Decision-1.1, scoring 68 on the Artificial Analysis Decision Index v2.1, a 6-point improvement over the previous generation Microsoft-Decision-1's score of 62, with all 6 sub-evaluations improving. The model ranks 8th, with pricing maintained at $0.042 per million input tokens; per-task latency is 123 ms, more than 2 times faster than the previous generation's 274 ms, ranking 5th on the speed leaderboard.
Body
Microsoft-Decision-1.1 scores 68 on the Artificial Analysis Decision Index v2.1
@Microsoft has released Microsoft-Decision-1.1, an update to their existing decision model, Microsoft-Decision-1. It remains priced at $0.042 per one million input tokens.
Key results:
➤ Microsoft-Decision-1.1 is the #8 decision model. On the Artificial Analysis Decision Index, Microsoft-Decision-1.1 scores 2 points ahead of Elephant 9B and Jev 1.14 but 1 point behind d1.2.
➤ Microsoft-Decision-1.1 improves by 6 points over its predecessor. Microsoft-Decision-1.1’s score increases by 6 points to 68 from Microsoft-Decision-1’s 62, improving across all 6 individual evaluations that make up the Artificial Analysis Decision Index.
➤ Microsoft-Decision-1.1 is the #5 fastest model on a per task basis. Microsoft-Decision-1.1 has a Time per Task on the Artificial Analysis Decision Index of 123 ms, faster than d1.2 (150 ms) but not as a fast as Mammoth 27B (106 ms). It is more than 2x as fast as Microsoft-Decision-1 (274 ms).
AI Trends