Peter Berggren

Jan 20, 2025 | lesswrong.com | Peter Berggren

A lot of people within AI safety and adjacent ecosystems have discussed AI notkilleveryoneism megaproject ideas, but there appears to be a key problem with these previous discussions. These discussions presuppose that the funding landscape will not change much in the near future, in ways that have proven inaccurate in the past (e.g. assuming that FTX funding would last forever).

Jan 11, 2025 | lesswrong.com | Peter Berggren

I decided, as a challenge to myself, to spend 5 minutes, by the clock, solving the alignment problem. This is the result, plus 25 minutes of writing it up. As such, it might be a bit unpolished, but I hope that it can still be instructive. This proposal is loosely based on iterated amplification, a proposal for training AIs on difficult problems that are hard for humans to judge by using human judgments on simpler problems.

Nov 22, 2024 | lesswrong.com | Peter Berggren

Having recognized that I have asked these same questions repeatedly across a wide range of channels and have never gotten satisfying answers for them, I'm compiling them here so that they can be discussed by a wide range of people in an ongoing way. Why has EV made many moves in the direction of decentralizing EA, rather than in the direction of centralizing it?

Feb 11, 2024 | lesswrong.com | Peter Berggren

I just read the article https://arbital.com/p/likelihoods_not_pvalues/, but this left me with one big question: what is the actual sequence of actions a researcher would take to report a likelihood function based on their research? For background, I'm an undergraduate student who has participated in multiple undergraduate research positions, and who has so far been uncertain about how to compute and use likelihood functions based on the data (mostly econometric data) involved in this research.

Jan 5, 2024 | lesswrong.com | Rob Bensinger |Wei Dai |Peter Berggren |Seth Herd

As we announced back in October, I have taken on the senior leadership role at MIRI as its CEO. It’s a big pair of shoes to fill, and an awesome responsibility that I’m honored to take on. There have been several changes at MIRI since our 2020 strategic update, so let’s get into it.