Spoken Conversational Search

About

This project will research a new interaction paradigm for search engines, where all input and output is mediated via speech. While such information systems have been important for the visually impaired for many years, a renewed focus on speech is emerging driven by the ever growing sales of internet enabled smart phones. The phones allow internet access in new contexts that require both hands- and eyes-free interaction; one example being searching for
information while driving. Also, smart phones are being accessed by a new and large population of users across the world many of whom struggle with literacy; again requiring access mediated by speech. Currently, search systems poorly serve such a mode. Recent research showed that one cannot just ‘bolt on’ speech recognisers and screen readers to an existing system: a fundamental change to the way search is conducted is required.
Our Project Aim then is to research a new framework for effective information retrieval over a speech-only channel: Spoken Conversational Search (SCS), which provides a conversational approach to determining user information needs, presenting results, and enabling search reformulation.
The project is funded by the Australian Research Council Linkage projects scheme (LP130100563) and is a joint collaboration between RMIT University and RealThing Entertainment Pty Ltd.

RMIT logoRealThing logo

 

Publications

To Appear

  • D. Spina, J.R. Trippas, L.Cavedon and M. Sanderson.”Extracting Audio Summaries to Support Effective Spoken Document Search.” In Journal of the Association for Information Science and Technology (JASIST), To appear.
  • J.R. Trippas, D.Spina, D.Spina and M. Sanderson.”How do people interact in conversational speech-only search tasks: A preliminary analysis ” In Proceedings of the 2nd ACM SIGIR Conference on Human Information Interaction and Retrieval (CHIIR’17), 2017 (To appear).
  • 2016

     

    Resources

  • Dataset for preference study on audio podcast summaries: http://damiano.github.io/podcastsummaries/