Anthropic 发布 Transformer Circuit 早期研究视频
Transformer Circuit Videos
Anthropic 在 Transformer Circuits 页面发布了几段视频，记录团队早期尝试逆向工程神经网络的非正式思考，定位类似研究组会议上的早期结果分享。团队强调这些想法非常粗糙、可能存在错误，且其思考已大幅演进，前几段视频已被更完善的论文《A Mathematical Framework for Transformer Circuits》取代。
正文
当前显示原文，中文全文译文尚未就绪。
As an experiment, we recorded a couple videos discussing our early stage thinking on trying to reverse engineer neural networks. We made them to share our very informal thoughts with colleagues at other institutions.
Please treat these videos like talks one might give on early results at a research group meeting. Our thinking is very rough and errors are very possible. Please take all of these videos with a big grain of salt. We expect they're primarily of interest to people actively thinking about how to reverse engineer neural networks.
Our thoughts have evolved a lot since we started recording these videos. We're grateful to colleagues who gave feedback on our early thoughts! The first couple of these videos have since been superseded by our more polished paper, A Mathematical Framework for Transformer Circuits.
See Playlist on Youtube →