The CODI-CRAC 2022 Shared Task on Anaphora Resolution in Dialogues is the second edition of an initiative focused on detecting different types of anaphoric relations in conversations of different kinds. Using five conversational datasets, four of which have been newly annotated with a wide range of anaphoric relations: identity, bridging references and discourse deixis, we defined multiple tasks focusing individually on these key relations. The second edition of the shared task maintained the focus on these relations and used the same datasets as in 2021, but new test data were annotated, the 2021 data were checked, and new subtasks were added. In this paper, we discuss the annotation schemes, the datasets, the evaluation scripts used to assess the system performance on these tasks, and provide a brief summary of the participating systems and the results obtained across 230 runs from three teams, with most submissions achieving significantly better results than our baseline methods.
SEEK ID: https://publications.h-its.org/publications/1591
Research Groups: Natural Language Processing
Publication type: InProceedings
Citation: Proceedings of the CODI-CRAC 2022 Shared Task on Anaphora, Bridging, and Discourse Deixis in Dialogue, Gyeongju, Repbulic of Korea, October 2022, pp. 1--14
Date Published: 17th Oct 2022
URL: https://aclanthology.org/2022.codi-crac.1
Registered Mode: manually
Views: 2653
Created: 6th Feb 2023 at 14:30
Last updated: 5th Mar 2024 at 21:25
This item has not yet been tagged.
None