Understand this story
In the 20VC podcast, Microsoft Chairman and CEO Satya Nadella predicted that compute for the vast majority of enterprises' everyday scenarios will become commoditized, and that the underlying layer will see an extremely brutal price war. He mentioned that within Microsoft Copilot, cheap closed-source models and open-source models are heavily mixed and matched every day. Nadella also said he has abandoned the judgment that alignment will naturally emerge as parameter scale grows, and argues that alignment must be written into model weights, and that trust fences must be built outside the model on the premise that the model has already been compromised, with Agent 365 and Purview recording readable chains of thought and cross-reviewing them. He also proposed a reverse information paradox, arguing that the traces of enterprises' interactions with large models are providing reinforcement learning fuel to model vendors for free, and that in the future every enterprise will build private evaluation benchmarks, which will become core commercial intellectual property.
AI-generated from public reports
Developments
1 confirmed developments
- Source:Wallstreetcn
Reports and discussion timeline
Browse reports and discussion by time. Their evidence levels remain distinct.
Oct 27
IT Home · Artificial Intelligence
Microsoft CEO Nadella: No Longer Believes That Improved AI Capabilities Will Naturally Solve the Alignment Problem
Microsoft CEO Satya Nadella said on the "20VC" podcast that he previously believed that the more powerful an AI system becomes, the more easily its behavior would conform to human values and goals; he no longer believes the two will develop in natural sync, and said alignment may be a thornier problem of a different nature. He previously argued in an X post on October 10 for strengthening external security controls, believing that companies should treat AI models as internal security threats, design protections on the assumption that models have been compromised, and establish mechanisms through deterministic system design, human controls, and operating procedures.
IT Home · AIRelated discussion
IT Home · AI joined this discussion
This post contributes to heat; it is not a formal report or confirmed fact.
Wallstreetcn
Microsoft CEO Nadella: The compute price war is inevitable; in five years, enterprises' core asset will be proprietary evaluation benchmarks
Microsoft Chairman and CEO Satya Nadella said on the 20VC podcast that compute for the vast majority of everyday enterprise scenarios will become commoditized, and that the underlying layer will see an extremely brutal price war; inside Microsoft Copilot, cheap closed-source models and open-source models are heavily mixed and matched every day. He said he has abandoned the judgment that alignment will naturally emerge with parameter scale, and argues that alignment must be written into model weights, and that trust fences must be built outside the model on the premise that the model has already been compromised, with Agent 365 and Purview recording readable chain-of-thought and conducting cross-review. He also proposed the reverse information paradox, arguing that traces of enterprises' interactions with large models are providing reinforcement learning fuel to model vendors for free, and that in the future every enterprise will build private evaluation benchmarks, which will become core commercial intellectual property.
Phoenix Technology
Microsoft CEO Nadella: No Longer Believes That Improved AI Capabilities Will Naturally Solve the Alignment Problem
Microsoft CEO Satya Nadella said on the 20VC podcast that he previously believed that the more powerful AI systems become, the easier they would be to align with human values, but he no longer believes the two will naturally develop in sync, and said alignment may be a thornier and qualitatively different problem. He previously argued in a post on X on October 10 for strengthening external security controls, believing that companies should treat AI models as internal security threats, design protections on the assumption that models have already been compromised, and called for industry standards in areas where existing standards are insufficient.
Heat trend for this story
- Current
- 14
- Period peak
- 28 Oct 27 14:00
- 24-hour change
- -50%
Move the pointer or select the chart to inspect hourly heat. Use the left and right arrow keys with a keyboard.