Adam S. Jermyn

Dec 4, 2023 | lesswrong.com | Ben Pace |Alex Vermillion |Adam S. Jermyn |Vanessa Kosoy

The snow is falling, the carols are starting, and we all know it's time for our favorite winter holiday tradition. It's LessWrong review time!Each year we come together and review posts that are at least one year old. That means for the next two months we are reviewing all posts from 2022.

Feb 2, 2023 | lesswrong.com | Adam S. Jermyn |Johannes Treutlein |Rubi J. Hudson |Charlie Steiner

Thanks for your comment!Regarding 1: I don't think it would be good to simulate superintelligences with our predictive models. Rather, we want to simulate humans to elicit safe capabilities. We talk more about competitiveness of the approach in Section III. Regarding 3: I agree it might have been good to discuss cyborgism specifically. I think cyborgism is to some degree compatible with careful conditioning.

Feb 2, 2023 | lesswrong.com | Adam S. Jermyn |Johannes Treutlein |Rubi J. Hudson |Roman Leventov

Overall: I directionally and conceptually agree with most of what is said in this post, and only highlight and comment on the things that I disagree about (or not fully agree, or find ontologically or conceptually somewhat off). an agent minimizing its cross-entropy loss,I understand this is not the point of your paper and is just an example, yet I want to use the opportunity to discuss it. The training loss is not the agent's surprise.