-
Dec 2, 2024 | 
lesswrong.com | Rob Bensinger
MIRI is a nonprofit research organization with a mission of addressing the most serious hazards posed by smarter-than-human artificial intelligence. In our general strategy update and communications strategy update earlier this year, we announced a new strategy that we’re executing on at MIRI, and several new teams we’re spinning up as a result. This post serves as a status update on where things stand at MIRI today.
-
Sep 28, 2024 | 
lesswrong.com | Rob Bensinger |Ben Pace |Benito's Guide
A sequence is a series of multiple posts on Less Wrong on the same topic, to coherently and fully explore a particular thesis. See the Library page for a list of LessWrong sequences in their modern form. The original sequences were written by Eliezer Yudkowsky with the goal of creating a book on rationality. MIRI has since collated and editedthe sequences intoRationality: From AI to Zombies. If you are new to Less Wrong, this book is the best place to start.
-
Jun 6, 2024 | 
lesswrong.com | Rob Bensinger
(Cross-posted from Twitter.)My take on Leopold Aschenbrenner's new report: I think Leopold gets it right on a bunch of important counts. Three that I especially care about:Full AGI and ASI soon. (I think his arguments for this have a lot of holes, but he gets the basic point that superintelligence looks 5 or 15 years off rather than 50+.)This technology is an overwhelmingly huge deal, and if we play our cards wrong we're all dead.
-
Apr 17, 2024 | 
lesswrong.com | Rob Bensinger
xlr8harder writes:In general I don’t think an uploaded mind is you, but rather a copy. But one thought experiment makes me question this. A Ship of Theseus concept where individual neurons are replaced one at a time with a nanotechnological functional equivalent. Are you still you? Presumably the question xlr8harder cares about here isn't semantic question of how linguistic communities use the word "you", or predictions about how whole-brain emulation tech might change the way we use pronouns.
-
Apr 1, 2024 | 
lesswrong.com | Linda Linsefors |Seth Herd |Rob Bensinger
-
Jan 5, 2024 | 
lesswrong.com | Rob Bensinger |Wei Dai |Peter Berggren |Seth Herd
As we announced back in October, I have taken on the senior leadership role at MIRI as its CEO. It’s a big pair of shoes to fill, and an awesome responsibility that I’m honored to take on. There have been several changes at MIRI since our 2020 strategic update, so let’s get into it.
-
Dec 15, 2023 | 
lesswrong.com | Rob Bensinger |Seth Herd |Nathan Helm-Burger |Gerald M. Monroe
Alignment as Aimability or as Goalcraft? The Less Wrong and AI risk communities have obviously had a huge role in mainstreaming the concept of risks from artificial intelligence, but we have a serious terminology problem. The term "AI Alignment" has become popular, but people cannot agree whether it means something like making "Good" AI or whether it means something like making "Aimable" AI.
-
Dec 13, 2023 | 
lesswrong.com | Rob Bensinger |Audrey Tang |Daniel Kokotajlo |Gerald M. Monroe
is pretty much defined by how the question is interpreted. It could swing pretty wildly, but the obvious interpretation seems ~tautologically bad. So there's an argument here, one I don't subscribe to, but I have seen prominent AI experts make it implicitly. If you think about it, if you have children, and they have children, and so in a series of mortal generations, with each n+1 generation more and more of your genetic distinctiveness is being lost. Language and culture will evolve as well.
-
Oct 25, 2023 | 
lesswrong.com | Steven Byrnes |Thomas Kwa |Lukas Finnveden |Rob Bensinger
AI used to be a science. In the old days (back when AI didn't work very well), people were attempting to develop a working theory of cognition. Those scientists didn’t succeed, and those days are behind us. For most people working in AI today and dividing up their work hours between tasks, gone is the ambition to understand minds.
-
Oct 5, 2023 | 
lesswrong.com | Steven Byrnes |Matthew Barnett |Rob Bensinger |Eliezer Yudkowsky
ETA: I'm not saying that MIRI thought AIs wouldn't understand human values. If there's only one thing you take away from this post, please don't take away that. Here is Linch's attempted summary of this post, which I largely agree with.
