Danilo Neves Ribeiro

Sep 22, 2023 | amazon.science | Shen Wang |Xiaofei Ma |Henry Zhu |Danilo Neves Ribeiro

We introduce STREET, a unified multi-task and multi-domain natural language reasoning and explanation benchmark. Unlike most existing question-answering (QA) datasets, we expect models to not only answer questions, but also produce step-by-step structured explanations describing how premises in the question are used to produce intermediate conclusions that can prove the correctness of a certain answer.