TREC 2001 CROSS LANGUAGE DATASET

Description

Ten groups participated in the TREC-2001 cross-language information retrieval track, which focussed on retrieving Arabic language documents based on 25 queries that were originally prepared in English. French and Arabic translations of the queries were also available. This was the first year in which a large Arabic test collection was available, so a variety of approaches were tried and a rich set of experiments performed using resources such as machine translation, parallel corpora, several approaches to stemming and/or morphology, and both pre-translation and post-translation blind relevance feedback. On average, forty percent of the relevant documents discovered by a participating team were found by no other team, a higher rate than normally observed at TREC. This raises some concern that the relevance judgment pools may be less complete than has historically been the case.

Resources

Name Format Description Link
0 The Arabic search topics, for monolingual search. https://trec.nist.gov/data/topics_noneng/arabic_topics.txt
0 English topics for the 2001 CLIR track. https://trec.nist.gov/data/topics_noneng/english_topics.txt
0 The French topics for the TREC 2001 cross-language track https://ir.nist.gov/trec.nist.gov/data/topics_noneng/french_topics.txt
0 This file indicates the documents judged relevant for each of the topics. https://ir.nist.gov/trec.nist.gov/data/qrels_noneng/xlingual_t10qrels.txt
0 These are the documents used in this dataset. You must obtain them from the LDC at this URL. https://catalog.ldc.upenn.edu/LDC2001T55

Tags

  • trec-text-retrieval-conference

Topics

Categories