←新闻详情

Jakub Pachocki更新于 10月10日 11:13

Jakub Pachocki 澄清模型解题中的人工提示引导

Hi Nikhil! We will aim to publish more information next week, but as I noted above, this was a quite chaotic sprint (you caught us by surprise! please give us t

AI 导读

Jakub Pachocki 表示,模型解决问题 #6 时收到基于其此前尝试的 BSS barrier 方法提示,这类人工引导在严格受控实验中应被避免。问题 #1 的提示还要求模型不要引用链接已失效的 Hairer22;更多信息计划于下周公布,但分散的记录无法全部收集。

正文

当前显示原文,中文全文译文尚未就绪。

Hi Nikhil! We will aim to publish more information next week, but as I noted above, this was a quite chaotic sprint (you caught us by surprise! please give us time to prepare next time!). We will not be able to gather all the transcripts as they are quite scattered.

Some of the prompts included guidance to iterate on its previous work; e.g. the rollout that produced the solution to #6 was prompted with the problem statement followed by: "Trying using a BSS barrier type argument. You will have to think hard about the setup and the inductive framework to push it through." This guidance is based on the previous attempts by the model to solve the problem (which previously converged on this approach) and did not originate from the person who prompted the model; however, in a properly controlled experiment, we would avoid such manual prompting. (I didn't realize we used this prompting until today, otherwise I would have been more explicit about it in my original message!)

Also, for problem #1 we told the model "Do not cite Hairer22 or use it as a reference because the link no longer works."

来源

Jakub Pachocki