Explainability and Subjectivity in Textual Entailment: the e-RTE-3-it Dataset
We introduce the ’e-RTE-3-it’ dataset, an enriched version of the Italian RTE-3 dataset, where each text-hypothesis pair, in addition to the ’entailment’, ’contradiction’, or ’neutrality’ label, has been combined with an explanation for the relation. Moreover, the dataset includes the level of confi...
Uloženo v:
| Vydáno v: | URI:https://journals.openedition.org/ijcol, |
|---|---|
| Hlavní autoři: | , , |
| Médium: | Article ou chapitre numérique |
| Jazyk: | Anglais |
| Vydáno: |
IJCoL
2025
|
| On-line přístup: | Accès Université d'Orléans et IFPM |
| Shrnutí: | We introduce the ’e-RTE-3-it’ dataset, an enriched version of the Italian RTE-3 dataset, where each text-hypothesis pair, in addition to the ’entailment’, ’contradiction’, or ’neutrality’ label, has been combined with an explanation for the relation. Moreover, the dataset includes the level of confidence with which the annotators wrote the explanation as well as an optional alternative label, along with its explanation, which the annotators could express when they did not agree with the original label. This offers the opportunity to analyse cases of uncertainty in annotation and take into account different perspectives on natural language understanding and generation. |
|---|