Nathan Lambert on not knowing how to try Gemini in the agent era
Nathan Lambert said he does not know how to try Gemini in the agent era and believes he needs to make up for this. He mentioned that Gemini seems to have been absent since December 2025, but may be making a comeback. The tweet quoted Sundar Pichai's post announcing Gemini 4 Carbon, which said the model ranks first with 59 points on the Artificial Analysis Intelligence Index v5.0, and scored 88.2% on SEC-bench Pro, 54.8% on ExploitGym, and 71.0% on CWE-bench.
Why read this
AI score 76
Using his own experience as a starting point, the author points out the current situation in which Gemini has been overlooked by him in the agent phase, which can be compared with its model release cadence to see users' actual impressions.
Topics
View original postI did say we'd be releasing our models periodically...introducing Gemini 4 Carbon, our next frontier model. Following Argon's release just two weeks ago, Carbon shows the pace at which we’re pushing the frontier, it ranks #1 on the recently updated v5.0 of @ArtificialAnlys Intelligence Index at 59. It also leads across key cybersecurity evaluations scoring 88.2% on SEC-bench Pro for finding vulnerabilities, 54.8% on ExploitGym for exploitation, and 71.0% on CWE-bench for patching. We’re seeing significant improvements in long-horizon tasks even compared to Argon, and we’ve strengthened frontier safeguards. As we did with Argon, we’re going to roll it out gradually + responsibly. Some trusted cyber defenders will get access starting this week. We'll be expanding it to more partners through our Fairwind Program, ahead of wider availability soon, so hang tight!
View original
I did say we'd be releasing our models periodically...introducing Gemini 4 Carbon, our next frontier model. Following Argon's release just two weeks ago, Carbon shows the pace at which we’re pushing the frontier, it ranks #1 on the recently updated v5.0 of @ArtificialAnlys Intelligence Index at 59. It also leads across key cybersecurity evaluations scoring 88.2% on SEC-bench Pro for finding vulnerabilities, 54.8% on ExploitGym for exploitation, and 71.0% on CWE-bench for patching. We’re seeing significant improvements in long-horizon tasks even compared to Argon, and we’ve strengthened frontier safeguards. As we did with Argon, we’re going to roll it out gradually + responsibly. Some trusted cyber defenders will get access starting this week. We'll be expanding it to more partners through our Fairwind Program, ahead of wider availability soon, so hang tight!
Body
I honestly don’t know how to try Gemini in the agentic era, maybe I finally need to fix that. Pretty wild they just have been out of it since December 2025 but look maybe back.