Description
The Tip-of-the-Tongue (ToT) Track focuses on the known-item identification task where the searcher has previously experienced or consumed the item (e.g., a movie) but cannot recall a reliable identifier (i.e., It's on the tip of my tongue...). Unlike traditional ad-hoc keyword-based search, these information requests tend to be natural-language, verbose, and complex containing a wide variety of search strategies such as multi-hop reasoning, and frequently express uncertainty and suffer from false memories.
Resources
| Name | Format | Description | Link |
|---|---|---|---|
| 2023 Tip-of-the-Tongue development data | ZIP | 2023-dev.zip | Open resource |
| 2023 Tip of the Tongue QRels | Text | 2023-qrels.txt | Open resource |
| 2023 Tip-of-the-Tongue test data | ZIP | 2023-test.zip | Open resource |
| 2023 Tip-of-the-Tongue training data | ZIP | 2023-train.zip | Open resource |
| 2023 Tip-of-the-Tongue corpus | Unknown | This corpus is distributed by the track coordinators via Zenodo | Open resource |