从词袋到 Jev:文本分类模型的技术演进与 Jev 实测
Sebastian Raschka 撰文梳理文本分类从词袋模型、RNN、CNN 到 BERT 与 GPT 式 LLM 的演进,并分析近期走红的 Jev 模型。他用 Jev 的 Choice 与 Noul API 在 IMDb 2.5 万条测试集上实测,准确率分别为 96.47% 和 96.20%,总成本约 0.65 美元、耗时约 22 分钟,与微调 ModernBERT 的准确率接近。作者认为 Jev 的价值在于无需针对每个任务微调即可跨任务使用,并推测其架构接近 ModernBERT、训练数据为合成数据、训练方法为 TypeSafe AI 自研的 RLCD。
much defined by the rivalry between two different approaches: Encoder-style models like BERT, primarily developed by Google; Decoder-style models like GPT, primarily developed by OpenAI Encoder-style models were natural text classifiers, whereas GPT models could do zero- and few-shot classification as an emergent property, but their strength was more in generative tasks. But let’s start with encoder-style models and how to fine-tune and use them to classify text. One universal aspect of using t
匹配字段正文



