TREC 2023 Interactive Knowledge Acquisition Track dataset

Description

iKAT is the successor to the TREC Conversational Assistance Track (CAsT). The fourth year of CAST aimed to add more conversational elements to the interaction streams, by introducing mixed initiatives (clarifications, and suggestions) to create multi-path, multi-turn conversations for each topic. TREC iKAT evolves CAsT into a new track to signal this new trajectory. iKAT aims to focus on supporting multi-path, multi-turn, multi-perspective conversations. That is for a given topic, the direction and the conversation that evolves depends not only on the prior responses but also on the user.

Resources

Name Format Description Link
0 https://drive.google.com/file/d/1sNHmVYO9PVG2kFxLscPGhN-uCCUuDAu9/view?usp=sharing
0 https://drive.google.com/file/d/1zPSiAqLmbx9QFGm6walnuMUl7xoJmRB7/view?usp=sharing
47 2023-qrels.all-turns.txt https://trec.nist.gov/data/ikat/2023-qrels.all-turns.txt
47 2023-ptkb-qrels.txt https://trec.nist.gov/data/ikat/2023-ptkb-qrels.txt
0 obtain.php https://lemurproject.org/clueweb22/obtain.php

Tags

  • trec-text-retrieval-conference

Topics

Categories