AI Trends

Dario Amodei: AI Is Already Capable of Entry-Level Legal and Financial Consulting

AYi AI NotesUpdated Nov 18 08:10

English text is being prepared.

AI summary

Anthropic CEO Dario Amodei judges that AI is already capable of handling entry-level legal, financial, and consulting work, and will eliminate a large number of junior positions in the short term; he previously warned that within the next one to five years, half of entry-level white-collar jobs could be disrupted. His suggested way to break through is to "learn to use tools," and he divides usage capability into six levels, from everyday chatting to global command, believing that crossing the fourth-level Harness threshold (equipping models with fixed tools, long-term memory, and standard processes) is the real productivity watershed. He also cautions that in low-fault-tolerance businesses such as finance and law, systems cannot bear ultimate compliance and moral responsibility.

Quoted post

AYi

@AYi_AInotes

Holy crap, this is outrageous! An API key that had its withdrawal permissions explicitly disabled was still used to quietly move $10.39 million in USDC without anyone noticing. @GCSA_COM breaks down the process very clearly in this post. The most chilling part is that in this incident, the smart contract was not hacked, and the official SDK had no vulnerability. It was purely a trader's own signature code cutting corners, reusing the same nonce, and as a result, when the signatures of two transactions lying publicly on-chain collided, the private key was directly reverse-derived through a mathematical formula. The attacker who obtained the private key found that this key could not withdraw funds at all, so they simply switched to a detour: using the victim's own account to create a public liquidity pool and transfer all the money into it, then immediately having another sock-puppet account that had held shares in the pool in advance redeem it, and just like that $10 million was laundered out in a fully legal and compliant-looking way. Right now developers everywhere are stuffing all kinds of API keys into their AI agents, feeling smug and thinking that as long as they turn off high-risk switches like transfers, database deletion, and withdrawals, everything will be fine. But this $10 million lesson tears that security illusion to shreds. What truly determines the upper limit of risk is never which button you turned off, but whether the ordinary permissions you left open can be made to loop around the business rules into an equivalent infinite loop. From now on, before granting any AI agent permissions or API keys, develop a habit: first throw your checked permission list and business interface documentation to Claude, and directly instruct it to play the role of a hacker, specifically looking for a path that can route assets or data out without touching high-risk switches. This trick can help you plug ninety percent of hidden vulnerabilities in advance.

View original

卧槽,太离谱了!一把明确关掉了提现权限的 API key,居然照样被人神不知鬼不觉搬走了 1039 万美元的 USDC,@GCSA_COM这篇把过程拆解的特别清楚, 最让人后背发凉的是,这起事故里智能合约没被黑,官方 SDK 也没有漏洞, 纯粹是一个交易员自己写的签名代码图省事,重复使用了同一个随机数,结果链上公开躺着的两笔交易签名一碰撞,私钥直接被数学公式反推了出来。 拿到私钥的攻击者发现这把 key 根本提不了现,于是干脆换了个绕路打法,直接用受害者账户自己建了一个公共资金池把钱全转进去, 紧接着让另一个提前持有池子份额的马甲账户一脚赎回,一千万美金就这么合法合规地洗出去了。 现在满大街的开发者都在给自己的 AI agent 塞各种 API key,心里还美滋滋觉得只要把转账、删库、提现这些高危开关关掉就万事大吉了, 但这起千万美金的教训直接把这层安全幻觉撕了个粉碎,真正决定风险上限的从来不是你关掉了哪个按钮, 而是你放开的那几个普通权限能不能在业务规则里绕出一个等效的死循环。 以后在给任何 AI agent 发放权限或 API key 之前,养成一个习惯, 先把你勾选的权限清单和业务接口文档丢给 Claude,直接下指令让它扮演黑客, 专门找一条不碰高危开关也能把资产或数据绕出去的路径,这招能帮你提前堵死九成隐形漏洞。

View original post

Body

Anthropic 首席执行官 Dario Amodei 最近在回应刚毕业的高中生该如何规划未来时,给出了一个毫不留情的冷酷判断:人工智能已经能够胜任入门级的法律、金融与咨询业务,并且将在短期内直接消灭一大批初级岗位。 这不是他第一次拉响警报,他此前就公开预警过,未来一到五年内,整整一半的入门级白领工作都可能遭到彻底颠覆。 大家默认以为历次技术革命就像当年人类从农场走进工厂、再从工厂跨进互联网一样,每次转变总会留出几十年甚至几代人的缓冲期让普通人慢慢适应。 但这一次的技术切割不仅刺进了脑力劳动的深水区,而且渗透速度快到根本不给传统教育留出调整学制的窗口期。 他给出的破局建议听起来平平无奇,只有学会用工具四个字,但绝大多数人根本没意识到,会用这两个字背后其实横着一道从聊天到指挥官的六级天堑: 第一层是日常聊天,第二层是琢磨提示词,第三层是调用现成智能体,第四层是搭建专属的工作流底座,第五层是让系统自动化循环运转,最高层则是人彻底退居幕后做全局指挥。 市面上超过九成的人都死死卡在前两层,每天依然停留在把对话框当成高级搜索引擎的阶段,真正拉开个人产能百倍差距的分水岭,在于有没有跨过第四级的 Harness 门槛,也就是亲手给模型配齐固定工具、长效记忆与标准流程,让它按你的业务规矩反复干活,而不是每次都从零开始重新聊。 留个清醒,搭建自动化体系虽然能成倍放大单兵作战效率,但在金融、法律等容错率极低的严肃业务里,系统依然无法替人类承担最终的合规与道德责任,越是自动化循环运转,人类在验收节点上的判断力就越不能缺席。 未来职场最残酷的淘汰从来不是不会打字,而是当别人已经坐拥一整支随时待命的自动化执行团队时,你还在对着对话框一字一句地重新解释背景。 https://t.co/8dAyR0ztFO

Source

AYi AI Notes