Marcus Collins

Jul 8, 2024 | amazon.science | Marcus Collins |Eugene Agichtein |Oleg Rokhlenko |Shervin Malmasi

Continued improvement of conversational assistants in knowledge-rich domains like E-Commerce requires large volumes of realistic high-quality conversation data to power increasingly sophisticated LLM chatbots, dialogue managers, response rankers, and recommenders. The problem is worse for multi-modal interactions in realistic conversational product search and recommendation.

May 17, 2024 | amazon.science | Jason Choi |Marcus Collins |Eugene Agichtein |Oleg Rokhlenko

Conversational AI is a subtype of Human-Computer Interaction that has gained wide adoption. These systems are typically powered by Large Language Models (LLMs) that use Retrieval Augmented Generation (RAG) to infuse external knowledge, which is effective against issues like hallucination. However, automatically evaluating retrieval augmented conversations with minimal human effort remains challenging, particularly in online settings.