Understand this story
AI alignment researcher Soares offered his judgment, believing that within the next decade the probability of AI causing human extinction exceeds one half. He says he has not added to his retirement savings in ten years, citing worry over this risk. According to a TechSpot report, Soares is Nate Soares, president of the Machine Intelligence Research Institute (MIRI), who has worked on AI alignment research for 12 years, previously served as an engineer at Google and Microsoft, and is the author of "If Anyone Builds It, Everyone Dies." He believes the danger lies not in a superintelligence hating humanity, but in its not caring whether humans live or die, and in the possibility that humans become obstacles to its goals; once a system can autonomously obtain energy and chips and build automated infrastructure that does not depend on humans, humans will find it hard to constrain it. He also believes this dangerous race is not inevitable, and advocates that governments stop training artificial general intelligence systems and redirect efforts toward concrete uses such as cancer research and safer autonomous driving.
AI-generated from public reports
Latest update · Discussion
Fortune Tech joined this discussionDevelopments
1 confirmed developments
Reports and discussion timeline
Browse reports and discussion by time. Their evidence levels remain distinct.
Oct 28
Fortune TechRelated discussion
Fortune Tech joined this discussion
This post contributes to heat; it is not a formal report or confirmed fact.
cnBeta
AI safety researcher Suarez says there is a greater-than-even chance AI causes human extinction within ten years, and that he has not contributed to retirement savings for ten years
AI alignment researcher Suarez judges that there is a greater-than-even probability that AI will cause human extinction within the next ten years, and says he has not added to his retirement savings for ten years. He believes the risk comes from the possibility that superintelligence may not care about human survival, and that once it can autonomously obtain energy and chips and build automated infrastructure that does not depend on humans, humans will find it difficult to constrain it. He advocates that governments stop training artificial general intelligence systems and shift to specific uses such as cancer research and safer autonomous driving.
cnBetaRelated discussion
cnBeta joined this discussion
This post contributes to heat; it is not a formal report or confirmed fact.
Oct 27
TechSpot
MIRI President Nate Soares Has Stopped Saving for Retirement Out of Fear That AI Will Cause Human Extinction Within a Decade
Nate Soares, president of the Machine Intelligence Research Institute (MIRI), said he has stopped saving for retirement because he fears AI could cause human extinction within the next decade. Soares has worked on AI alignment research for 12 years, previously worked as an engineer at Google and Microsoft, and is the author of "If Anyone Builds It, Everyone Dies." He believes the danger is not that a superintelligence would hate humanity, but that it would not care whether humans live or die, and that humans could become obstacles to its goals; however, he also believes this dangerous race is not inevitable and could still be stopped.
Heat trend for this story
- Current
- 23
- Period peak
- 26 Oct 28 11:00
- 24-hour change
- —
Move the pointer or select the chart to inspect hourly heat. Use the left and right arrow keys with a keyboard.