David Matolcsi

Nov 20, 2024 | lesswrong.com | Zach Stein-Perlman |David Matolcsi |Daniel Kokotajlo

I experimented a bunch with DeepSeek today, it seems to be exactly on the same level in highs school competition math as o1-preview in my experiments. So I don't think it's benchmark-gaming, at least in math. On the other hand, it's noticeably worse than even the original GPT-4 at understanding a short story I also always test models on.

Nov 17, 2024 | lesswrong.com | David Matolcsi

[Warning: This post is probably only worth reading if you already have opinions on the Solomonoff induction being malign, or at least heard of the concept and want to understand it better.]I recently reread the classic argument from Paul Christiano about the Solomonoff prior being malign, and Mark Xu's write-up on it.

Sep 29, 2024 | lesswrong.com | David Matolcsi

There has been a renewal of discussion on how much hope we should  have of an unaligned AGI leaving humanity alive on Earth after a takeover. When this topic is discussed, the idea of using simulation arguments or acausal trade to make the AI spare our lives often come up. These ideas have a long history.