Towards a Semantic Model for Textual Entailment Annotation

Authors

  • Assaf Toledo Utrecht University
  • Stavroula Alexandropoulou Utrecht University
  • Sophie Chesney University College London
  • Sophia Katrenko
  • Heidi Klockmann University of Utrecht
  • Pepijn Kokke Utrecht University
  • Benno Kruit University of Amsterdam
  • Yoad Winter Utrecht University

DOI:

https://doi.org/10.33011/lilt.v9i.1331

Abstract

We introduce a new formal semantic model for annotating textual entailments that describes restrictive, intersective, and appositive modification. The model contains a formally defined interpreted lexicon, which specifies the inventory of symbols and the supported semantic operators, and an informally defined annotation scheme that instructs annotators in which way to bind words and constructions from a given pair of premise and hypothesis to the interpreted lexicon. We explore the applicability of the proposed model to the Recognizing Textual Entailment (RTE) 1–4 corpora and describe a first-stage annotation scheme on which we based the manual annotation work. The constructions we annotated were found to occur in 80.65% of the entailments in RTE 1–4 and were annotated with cross-annotator agreement of 68% on average. The annotated parts of the RTE corpora are publicly available for further research.

Downloads

Published

2014-01-01

How to Cite

Toledo, A., Alexandropoulou, S., Chesney, S., Katrenko, S., Klockmann, H., Kokke, P., Kruit, B., & Winter, Y. (2014). Towards a Semantic Model for Textual Entailment Annotation. Linguistic Issues in Language Technology, 9, 117–150. https://doi.org/10.33011/lilt.v9i.1331

Issue

Vol. 9 (2014): Perspectives on Semantic Representations for Textual Inference

Section

Articles

License

This work is licensed under CC BY 4.0, which permits you to use, share, adapt, distribute, and reproduce it in any medium or format, provided you credit the original author(s) and source.