Anthropic 提出稀疏 crosscoders:跨层特征与模型对比
Anthropic 的 Transformer Circuits 提出稀疏 crosscoders,一种可同时读写多层激活的稀疏自编码器变体,能产生跨层甚至跨模型的共享特征。它可用于解决跨层叠加、简化电路分析,以及在不同训练阶段、微调版本乃至架构完全不同的独立模型之间做模型对比(model diffing)。该文给出理论示例和初步实验,电路简化的具体结果留待后续更新。
es between data points; this approach was rediscovered by Olah who, inspired by Erhan et al. visualizing collections of networks by studying them in function space, developed the "meta-SNE" algorithm canonicalizing network representations in this manner and visualizing their space. A second line of attack took off in 2015 based on model stitching , which studied the similarities of representations by trying to plug representations from one model into the intermediate layers of another with some
匹配字段正文





