Overview of the TREC 2024 Tip-of-the-Tongue Track

  • Jaime Arguello ,
  • Samarth Bhargav ,
  • Fernando Diaz ,
  • To Eun Kim ,
  • Yifan He ,
  • Evangelos Kanoulas ,
  • Bhaskar Mitra

Text REtrieval Conference (TREC) |

Published by TREC | Organized by NIST

PDF

Download BibTex

Tip-of-the-tongue (ToT) known-item retrieval involves re-finding an item for which the searcher does not reliably recall an identifier. ToT information requests (or queries) are verbose and tend to include several complex phenomena, making them especially difficult for existing information retrieval systems. The TREC 2024 ToT track focused on a single ad-hoc retrieval task. Participants were provided with training and development data in the movie domain. Conversely, systems were tested on data that combined three domains: movies, celebrities, and landmarks. This year, 6 groups (including the track coordinators) submitted 18 runs.

Related Tools

TREC Tip-of-the-Tongue Track

Tip-of-the-tongue (ToT) known-item retrieval is defined as "an item identification task in which the searcher has previously experienced an item but cannot recall a reliable identifier" (i.e., "It’s on the tip of my tongue…"). The TREC ToT track aims to develop IR systems that can successfully resolve ToT information needs. Progress in this area will likely benefit other IR systems that must deal with memory assistance, such as personal information management (PIM) systems (e.g., email re-finding).

Access