Zaid Zada

1 month ago | nature.com | Ariel Goldstein |Haocheng Wang |Zaid Zada |Samuel A. Nastase |Michael Brenner |Yossi Matias | +2 more

AbstractThis study introduces a unified computational framework connecting acoustic, speech and word-level linguistic structures to study the neural basis of everyday conversations in the human brain. We used electrocorticography to record neural signals across 100 h of speech production and comprehension as participants engaged in open-ended real-life conversations. We extracted low-level acoustic, mid-level speech and contextual word embeddings from a multimodal speech-to-text model (Whisper).