Initiative for the Evaluation of XML retrieval

Allgemeine Informationen

Beschreibung

The widespread use of XML in digital libraries, product catalogues, scientific data repositories and across the Web prompted the development of appropriate searching and browsing methods for XML documents. This initiative provides an opportunity for participants to evaluate their retrieval methods using uniform scoring procedures and a forum for participating organisations to compare their results. As part of a large-scale effort to improve the efficiency of research in information retrieval and digital libraries, this project initiates an international, coordinated effort to promote evaluation procedures for content-based XML retrieval. Participating organisations contribute to the construction of a large testbed (test collection) of XML documents. The test collection (consisting of 12,000 XML documents with about 500 megabytes of data) provides participants a means for future comparative and quantitative experiments. For additional information about this project please refer to the home pages of the annual initiatives:

• INEX 2009 iTrack
• INEX 2008
• INEX 2007
• INEX 2006
• INEX 2005
• INEX 2004
• INEX 2003
• INEX 2002

Publikationen

• Norbert Fuhr; Mounia Lalmas; Andrew Trotman; Jaap Kamps (Hrsg.) (2008).
  Focused access to XML documents: 6th International Workshop of the Initiative for the Evaluation of XML Retrieval (INEX 2007). Number in LNCS, Springer
• Norbert Fuhr; Mounia Lalmas (2007).
  Advances in XML retrieval: the INEX initiative. In: IWRIDL '06: Proceedings of the 2006 international workshop on Research issues in digital libraries. ACM, New York, NY, USA.
• Norbert Fuhr; Mounia Lalmas; Andrew Trotman (Hrsg.) (2007).
  Comparative Evaluation of XML Information Retrieval Systems, 5th International Workshop of the Initiative for the Evaluation of XML Retrieval, INEX 2006. Number 4518 in LNCSSpringer, Heidelberg et al..
• Norbert Fuhr; Mounia Lalmas; Saadia Malik; Gabriella Kazai (Hrsg.) (2006).
  Advances in XML Information Retrieval and Evaluation: Fourth Workshop of the INitiative for the Evaluation of XML Retrieval (INEX 2005), Dagstuhl 28-30 November 2005, Lecture Notes in Computer Science. 3977, Springer-Verlag GmbH
• Birger Larsen; Saadia Malik; Anastasios Tombros (2006).
  The Interactive Track at INEX 2005. In: Advances in XML Information Retrieval and Evaluation: Fourth Workshop of the Initiative for the Evaluation of XML Retrieval (INEX 2005)
• Birger Larsen; Anastasios Tombros; Saadia Malik (2006).
  Is XML retrieval meaningful to users? Searcher preferences for full documents vs. elements. In: SIGIR 2006
• Saadia Malik; Claus-Peter Klas; Norbert Fuhr; Birger Larsen; Anastasios Tombros (2006).
  Designing a User Interface for Interactive Retrieval of Structured Documents --- Lessons Learned from the INEX Interactive Track. In: Proc. European Conference on Digital Libraries
• Norbert Fuhr; Mounia Lalmas; Saadia Malik; Zoltan Szlavik (Hrsg.) (2005).
  Advances in XML Information Retrieval: Third International Workshop of the Initiative for the Evaluation of XML Retrieval, INEX 2004, Dagstuhl Castle, Germany, December 6-8, 2004, Revised Selected Papers. 3493, Springer-Verlag GmbH
• Norbert Fuhr; Mounia Lalmas; Saadia Malik; Gabriella Kazai (Hrsg.) (2005).
  INEX 2005 Workshop Pre-Proceedings. Schloss Dagstuhl, November 28-30, 2005.
• Saadia Malik, Mounia Lalmas, Norbert Fuhr (2005).
  Overview of INEX 2004. In Advances in XML Information Retrieval: Third International Workshop of the Initiative for the Evaluation of XML Retrieval, INEX 2004, Dagstuhl Castle, Germany, December 6-8, 2004, Revised Selected Papers
• Anastasios Tombros; Birger Larsen; Saadia Malik (2005).
  The Interactive Track at INEX 2004. In Advances in XML Information Retrieval: Third International Workshop of the Initiative for the Evaluation of XML Retrieval, INEX 2004, Dagstuhl Castle, Germany, December 6-8, 2004, Revised Selected Papers
• Anastosios Tombros; Saadia Malik; Birger Larsen (2005).
  Report on the INEX 2004 interactive track. SIGIR Forum 39(1)
• Norbert Fuhr; Saadia Malik; Mounia Lalmas (2004).
  Overview of the INitiative for the Evaluation of XML Retrieval (INEX) 2003. In INitiative for the Evaluation of XML Retrieval (INEX). Proceedings of the Second INEX Workshop. Dagstuhl, Germany, December 15--17, 2003
• N. Fuhr; M. Lalmas (2004).
  Report on the INEX 2003 Workshop. SIGIR Forum 38(1)
• Norbert Fuhr; Mounia Lalmas; Saadia Malik (Hrsg.) (2004).
  INitiative for the Evaluation of XML Retrieval (INEX). Proceedings of the Second INEX Workshop. Dagstuhl, Germany, December 15--17, 2003.
• B. Larsen, A. Tombros; S. Malik (2004).
  End Users in Context of XML Documents:Setting up an Interactive track in INEX. In: SIGIR 2004 IRiX Workshop
• Norbert Gövert; Gabriella Kazai; Norbert Fuhr; Mounia Lalmas (2003).
  Evaluating the effectiveness of content-oriented XML retrieval. Technischer Bericht, University of Dortmund, Computer Science 6
• Norbert Gövert; Gabriella Kazai (2003).
  Overview of the INitiative for the Evaluation of XML retrieval (INEX) 2002. In INitiative for the Evaluation of XML Retrieval (INEX). Proceedings of the First INEX Workshop. Dagstuhl, Germany, December 8--11, 2002
• Norbert Fuhr; Norbert Gövert; Gabriella Kazai; Mounia Lalmas (Hrsg.) (2003).
  INitiative for the Evaluation of XML Retrieval (INEX). Proceedings of the First INEX Workshop. Dagstuhl, Germany, December 8--11, 2002. , ERCIM Workshop ProceedingsERCIM, Sophia Antipolis, France.
• Gabriella Kazai; Mounia Lalmas; Norbert Fuhr; Norbert Gövert (2003).
  A report on the first year of the INitiative for the Evaluation of XML Retrieval (INEX 02). Journal of the American Society for Information Science and Technology 54
• G. Kazai; N. Gövert; M. Lalmas; N. Fuhr (2003)
  The INEX evaluation initiative.
• Norbert Fuhr; Norbert Gövert; Gabriella Kazai; Mounia Lalmas (2002).
  INEX: INitiative for the Evaluation of XML Retrieval. In Proceedings of the SIGIR 2002 Workshop on XML and Information Retrieval

Vorträge

• Norbert Fuhr (2004).
  XML Information Retrieval - Achievements and Challenges. Talk at the Twente Data Mangement Workshop

Diplom-, Master- und Bachelorarbeiten

• Visualization of XML search interaction
  Abgeschlossene Diplomarbeit
• Effective support for query formulation and reformulation
  Abgeschlossene Masterarbeit
• Eyetrackergestützte Evaluierung eines interaktiven Suchsystems
  Abgeschlossene Masterarbeit

Verwandte Projekte

• DELOS
  A Network of Excellence on Digital Libraries (FP6)
• CLASSIX
  Classification and Intelligent Search on Information in XML
• DAFFODIL
  Nutzerorientiertes Zugangssystem für heterogene Digitale Bibliotheken
• HyREX
  Hyper-media Retrieval Engine for XML

Bemerkungen

Due to copyright issues, only participating organisations will have access to the constructed test collection.