←新闻详情

Lilian Weng更新于 10月21日 22:46

Thinky 首个产品或为训练超参实体旋钮面板

Probably the first product Thinky will build is a full panel of dials that researchers can use to physically adjust all the hparams during training. We gonna do

AI 导读

Thinky 要做的第一个产品,大概是一整块旋钮面板,让研究人员能在训练过程中物理调节所有 hparams。我们总有一天要做硬件,时候到了 😂

引用

Stephen Roller

@stephenroller

Some teams use sweeps, heuristics, or scaling laws to determine their training LR. At Character, we just have Noam Shazeer dial it to the right value. https://t.co/bJRqirA7YT

查看原帖

正文

当前显示原文,中文全文译文尚未就绪。

Probably the first product Thinky will build is a full panel of dials that researchers can use to physically adjust all the hparams during training. We gonna do hardware one day and it is the time 😂

来源

Lilian Weng