Nathan Lambert:大量推理服务需监控
I also agree with this — if you’re serving a lot of inference you should be monitoring. https://t.co/XYkNIZObwY
AI 导读
我也同意这一点——如果你在提供大量推理服务,就应该做监控。https://t.co/XYkNIZObwY
查看原帖Attackers using models across multiple inference providers during attacks seems like a pretty robust theme, which is why we need tight coordination between both open and closed weights inference providers to evict attackers everywhere when they are detected anywhere
正文
当前显示原文,中文全文译文尚未就绪。
I also agree with this — if you’re serving a lot of inference you should be monitoring. https://t.co/XYkNIZObwY