[Mova](https://md.mova.elamur.ai/free/en/) · [this page in HTML](https://mova.elamur.ai/free/en/docs/papers/kuthy-2018-qud-based-annotation-discourse-structure/)

[home](https://md.mova.elamur.ai/free/en/) / [docs](https://md.mova.elamur.ai/free/en/docs/) / [papers](https://md.mova.elamur.ai/free/en/docs/papers/) / [English](https://md.mova.elamur.ai/free/en/docs/papers/en/) / QUD-Based Annotation of Discourse Structure and Information Structure: Tool and Evaluation

# QUD-Based Annotation of Discourse Structure and Information Structure: Tool and Evaluation

**Authors:** [Kordula De Kuthy](https://md.mova.elamur.ai/free/en/docs/papers/authors/kordula-de-kuthy/), Nils Reiter, [Arndt Riester](https://md.mova.elamur.ai/free/en/docs/papers/authors/arndt-riester/) · **Year:** 2018 · **Venue:** LREC 2018 **Link:** [aclanthology.org/L18-1304](https://aclanthology.org/L18-1304/) · **Licence:** [CC BY-NC 4.0](https://creativecommons.org/licenses/by-nc/4.0/) (ELRA, LREC proceedings; the PDF is silent, the proceedings page states CC BY-NC 4.0) — summary only

[**22** citations in our library](https://md.mova.elamur.ai/free/en/docs/papers/cited-by/kuthy-2018-qud-based-annotation-discourse-structure/) of the 140673 papers whose bibliographies we read[Proceedings of the Eleventh International Conference on Language Resources and Evaluation (LREC 2018)](https://aclanthology.org/volumes/L18-1/)[licence](https://creativecommons.org/licenses/by-nc/4.0/)

- [Publisher's page](https://aclanthology.org/L18-1304/)
- [PDF](https://aclanthology.org/L18-1304.pdf)

**Authors (3)**

1. Kordula De Kuthy
2. Nils Reiter
3. Arndt Riester

Citations and author metrics from OpenAlex (); authors with the same name are not always told apart.

## What it is about

The paper tests the QUD-tree method of Riester and colleagues: a text is cut into atomic assertions (sentences, plus splits at coordinations and before optional adjuncts), each assertion is the answer to one explicit or implicit question under discussion, and the questions form the inner nodes of a tree whose leaves are the assertions in text order. Implicit QUDs are constrained by three principles: the QUD must be answerable by the assertion it dominates (congruence), may contain only given or salient material (givenness), and should contain as much given material as possible (maximal anaphoricity); parallel assertions share a QUD whose background is their common material. From the QUD, information structure follows: focus = the part answering the QUD, background = material in the QUD, contrastive topic, and non-at-issue material (e.g. «It was clear from the President's speech that…»). Two pairs of annotators worked on an English and a German interview with a new tool (TreeAnno): agreement on tree structure is moderate (kappa .45–.53, computed on the matrix of all segment spans after Marcu et al.), on information-structure labels substantial (.67–.69 overall; focus .63–.67).

## Ideas

- I1. Derive focus/background labels deterministically from Mova's QUD stack: once `world/src/qud.rs` attaches an assertion to a question, the words matching the question's content lemmas are background and the constituent filling the wh-slot is focus. Store the focus on the frame; the school student can then prefer, among remembered frames, the one whose focus fills the asked role. Measure on courses with `world knowledge diagnose` (step 5, right option outscored).
- I2. Implement maximal anaphoricity as the tie-breaker among candidate implicit QUDs in `qud.rs`: prefer the candidate with the most given lemmas that still passes congruence and givenness, and log the rejected ones with the violated principle, as the paper does for its examples.
- I3. Mark non-at-issue material: matrix clauses of evidence and attitude («it was clear from X that», «as everyone knows», appositives) are not what an assertion answers. In `prag/src/frames.rs` flag the frame of such a matrix as non-at-issue so that answer scoring weights the embedded frame. Count course questions whose answer frame sits under such a matrix.
- I4. Score QUD trees with the paper's span-matrix kappa (one cell per segment span: does a QUD span it?) when comparing `qud.rs` output with a teacher-made QUD tree on a few tales. It is cheap, needs no alignment of question wordings, and has a known human reference (about .5).

## For Mova

[29. Ellipsis, word order and information structure](https://md.mova.elamur.ai/free/en/docs/languages/en/29-ellipsis-word-order-information-structure/) (focus, background, contrastive topic) and `36-discourse-relations.md` §9 and §11.5 (QUD stack). Code: `world/src/qud.rs`, `prag/src/frames.rs`, `world/src/knowledge.rs`. Measures: span-matrix kappa against teacher trees; course answers after focus-aware scoring.

Topics: [Discourse analysis](https://md.mova.elamur.ai/free/en/docs/papers/topics/discourse-analysis/)

## Cite

The paper itself, not this card. BibTeX from the library's record of the work.

```
@inproceedings{kuthy2018qud,
  title = {{QUD-Based Annotation of Discourse Structure and Information Structure: Tool and Evaluation}},
  author = {Kuthy, Kordula De and Reiter, Nils and Riester, Arndt},
  booktitle = {Proceedings of the Eleventh International Conference on Language Resources and Evaluation (LREC 2018)},
  year = {2018},
  url = {https://aclanthology.org/L18-1304/}
}
```

- [← previous Beyond Identity Coreference: Contrasting Indicators of Textual Coherence in English and German](https://md.mova.elamur.ai/free/en/docs/papers/kunz-2016-beyond-identity-coreference-contrasting-indicators/)
- [next → Thematic role assignment in non-default verb classes: A cross-linguistic comparison of English and German](https://md.mova.elamur.ai/free/en/docs/papers/kyriaki-2021-thematic-role-assignment-non-default/)
- [↑ back to English](https://md.mova.elamur.ai/free/en/docs/papers/en/)

## References

24 references, 1 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Asher, N. and Lascarides, A. (2003). Logics of Conversation. Cambridge University Press. [find](https://scholar.google.com/scholar?q=Asher%2C+N%2E+and+Lascarides%2C+A%2E+%282003%29%2E+Logics+of+Conversation%2E+Cambridge+University+Press%2E)
2. Beaver, D. and Clark, B. (2008). Sense and Sensitivity. How Focus Determines Meaning. Wiley-Blackwell, Oxford. [find](https://scholar.google.com/scholar?q=Beaver%2C+D%2E+and+Clark%2C+B%2E+%282008%29%2E+Sense+and+Sensitivity%2E+How+Focus+Determines+Meaning%2E+Wiley%2DBlackwell%2C+Oxford%2E)
3. Büring, D. (2003). On D-trees, beans, and B-accents. Linguistics and Philosophy, 26(5):511–545. [find](https://scholar.google.com/scholar?q=Bu%CC%88ring%2C+D%2E+%282003%29%2E+On+D%2Dtrees%2C+beans%2C+and+B%2Daccents%2E+Linguistics+and+Philosophy%2C+26%285%29%3A511%E2%80%93545%2E)
4. Büring, D. (2008). What’s new (and what’s given) in the theory of focus? In Proceedings of the 34 th Annual Meeting of the Berkeley Linguistics Society, pages 403– 424. [find](https://scholar.google.com/scholar?q=Bu%CC%88ring%2C+D%2E+%282008%29%2E+What%E2%80%99s+new+%28and+what%E2%80%99s+given%29+in+the+theory+of+focus%3F+In+Proceedings+of+the+34+th+Annual+Meeting+of+the+Berkeley+Linguistics+Society%2C+pages+403%E2%80%93+424%2E)
5. Büring, D. (2016). Intonation and Meaning. Oxford University Press. [find](https://scholar.google.com/scholar?q=Bu%CC%88ring%2C+D%2E+%282016%29%2E+Intonation+and+Meaning%2E+Oxford+University+Press%2E)
6. Calhoun, S., Carletta, J., Brenier, J., Mayo, N., Jurafsky, D., Steedman, M., and Beaver, D. (2010). The NXT-format Switchboard corpus: A rich resource for investigating the syntax, semantics, pragmatics and prosody of dialogue. Language Resources and Evaluation, 44:387– 419. [find](https://scholar.google.com/scholar?q=Calhoun%2C+S%2E%2C+Carletta%2C+J%2E%2C+Brenier%2C+J%2E%2C+Mayo%2C+N%2E%2C+Jurafsky%2C+D%2E%2C+Steedman%2C+M%2E%2C+and+Beaver%2C+D%2E+%282010%29%2E+The+NXT%2Dformat+Switchboard+corpus%3A+A+rich+resource+for+investigating+the+syntax%2C+semantics%2C+pragmat)
7. Cohen, J. (1960). A coefficient of agreement for nominal scales. Educational and Psychological Measurement, 20(1):37–46. [find](https://scholar.google.com/scholar?q=Cohen%2C+J%2E+%281960%29%2E+A+coefficient+of+agreement+for+nominal+scales%2E+Educational+and+Psychological+Measurement%2C+20%281%29%3A37%E2%80%9346%2E)
8. Krifka, M. (2008). Basic notions of information structure. Acta Linguistica Hungarica, 55(3-4):243–276. [find](https://scholar.google.com/scholar?q=Krifka%2C+M%2E+%282008%29%2E+Basic+notions+of+information+structure%2E+Acta+Linguistica+Hungarica%2C+55%283%2D4%29%3A243%E2%80%93276%2E)
9. Kruijff-Korbayová, I. and Steedman, M. (2003). Discourse and information structure. Journal of Logic, Language and Information, 12:249–259. [find](https://scholar.google.com/scholar?q=Kruijff%2DKorbayova%CC%81%2C+I%2E+and+Steedman%2C+M%2E+%282003%29%2E+Discourse+and+information+structure%2E+Journal+of+Logic%2C+Language+and+Information%2C+12%3A249%E2%80%93259%2E)
10. Marcu, D., Amorrortu, E., and Romera, M. (1999). Experiments in constructing a corpus of discourse trees. In Proceedings of the ACL Workshop on Standards and Tools for Discourse Tagging, pages 48–57, College Park, MD, USA. [find](https://scholar.google.com/scholar?q=Marcu%2C+D%2E%2C+Amorrortu%2C+E%2E%2C+and+Romera%2C+M%2E+%281999%29%2E+Experiments+in+constructing+a+corpus+of+discourse+trees%2E+In+Proceedings+of+the+ACL+Workshop+on+Standards+and+Tools+for+Discourse+Tagging%2C+pages+48%E2%80%9357%2C+)
11. Onea, E. (2016). Potential Questions at the Semantics-Pragmatics Interface. Brill, Leiden. [find](https://scholar.google.com/scholar?q=Onea%2C+E%2E+%282016%29%2E+Potential+Questions+at+the+Semantics%2DPragmatics+Interface%2E+Brill%2C+Leiden%2E)
12. Poláková, L., Mı́rovský, J., Nedoluzhko, A., Jı́nová, P., Zikánová, Š., and Hajičová, E. (2013). Introducing the Prague Discourse Treebank 1.0. In Proceedings of the International Joint Conference on Natural Language Processing, pages 91–99, Nagoya. [find](https://scholar.google.com/scholar?q=Pola%CC%81kova%CC%81%2C+L%2E%2C+M%C4%B1%CC%81rovsky%CC%81%2C+J%2E%2C+Nedoluzhko%2C+A%2E%2C+J%C4%B1%CC%81nova%CC%81%2C+P%2E%2C+Zika%CC%81nova%CC%81%2C+S%CC%8C%2E%2C+and+Hajic%CC%8Cova%CC%81%2C+E%2E+%282013%29%2E+Introducing+the+Prague+Discourse+Treebank+1%2E0%2E+In+Proceedings+of+the+International+Joint+Confe)
13. Polanyi, L., van den Berg, M., and Ahn, D. (2003). Discourse structure and sentential information structure: An initial proposal. Journal of Logic, Language and Information, 12:337–350. [find](https://scholar.google.com/scholar?q=Polanyi%2C+L%2E%2C+van+den+Berg%2C+M%2E%2C+and+Ahn%2C+D%2E+%282003%29%2E+Discourse+structure+and+sentential+information+structure%3A+An+initial+proposal%2E+Journal+of+Logic%2C+Language+and+Information%2C+12%3A337%E2%80%93350%2E)
14. Polanyi, L. (1988). A formal model of the structure of discourse. Journal of Pragmatics, 12(5-6):601–638. [find](https://scholar.google.com/scholar?q=Polanyi%2C+L%2E+%281988%29%2E+A+formal+model+of+the+structure+of+discourse%2E+Journal+of+Pragmatics%2C+12%285%2D6%29%3A601%E2%80%93638%2E)
15. Reyle, U. and Riester, A. (2016). Joint information structure and discourse structure analysis in an Underspecified DRT framework. In Julie Hunter, et al., editors, Proceedings of the 20 th Workshop on the Semantics and Pragmatics of Dialogue (JerSem), pages 15–24, New Brunswick, NJ, USA. [find](https://scholar.google.com/scholar?q=Reyle%2C+U%2E+and+Riester%2C+A%2E+%282016%29%2E+Joint+information+structure+and+discourse+structure+analysis+in+an+Underspecified+DRT+framework%2E+In+Julie+Hunter%2C+et+al%2E%2C+editors%2C+Proceedings+of+the+20+th+Workshop+o)
16. Ritz, J., Dipper, S., and Götze, M. (2008). Annotation of information structure: An evaluation across different types of texts. In Proceedings of the Sixth International Conference on Language Resources and Evaluation (LREC), pages 2137–2142, Marrakesh. [find](https://scholar.google.com/scholar?q=Ritz%2C+J%2E%2C+Dipper%2C+S%2E%2C+and+Go%CC%88tze%2C+M%2E+%282008%29%2E+Annotation+of+information+structure%3A+An+evaluation+across+different+types+of+texts%2E+In+Proceedings+of+the+Sixth+International+Conference+on+Language+Resour)
17. Roberts, C. (2012). Information structure in discourse: Towards an integrated formal theory of pragmatics. Semantics and Pragmatics, 5(6):1–69. [find](https://scholar.google.com/scholar?q=Roberts%2C+C%2E+%282012%29%2E+Information+structure+in+discourse%3A+Towards+an+integrated+formal+theory+of+pragmatics%2E+Semantics+and+Pragmatics%2C+5%286%29%3A1%E2%80%9369%2E) [our card](https://md.mova.elamur.ai/free/en/docs/papers/roberts-2012-information-structure-discourse-towards-integrated/)
18. Rooth, M. (1992). A theory of focus interpretation. Natural Language Semantics, 1(1):75–116. [find](https://scholar.google.com/scholar?q=Rooth%2C+M%2E+%281992%29%2E+A+theory+of+focus+interpretation%2E+Natural+Language+Semantics%2C+1%281%29%3A75%E2%80%93116%2E)
19. Schwarzschild, R. (1999). GIVENness, AvoidF, and other constraints on the placement of accent. Natural Language Semantics, 7(2):141–177. [find](https://scholar.google.com/scholar?q=Schwarzschild%2C+R%2E+%281999%29%2E+GIVENness%2C+AvoidF%2C+and+other+constraints+on+the+placement+of+accent%2E+Natural+Language+Semantics%2C+7%282%29%3A141%E2%80%93177%2E)
20. Schweitzer, K., Eckart, K., Gärtner, M., Faleńska, A., Riester, A., Rösiger, I., Schweitzer, A., Stehwien, S., and Kuhn, J. (2018). German Radio Interviews: The GRAIN release of the SFB732 silver standard collection. In Proceedings of the Eleventh Language Resources and Evaluation Conference (LREC), Miyazaki, JP. [find](https://scholar.google.com/scholar?q=Schweitzer%2C+K%2E%2C+Eckart%2C+K%2E%2C+Ga%CC%88rtner%2C+M%2E%2C+Falen%CC%81ska%2C+A%2E%2C+Riester%2C+A%2E%2C+Ro%CC%88siger%2C+I%2E%2C+Schweitzer%2C+A%2E%2C+Stehwien%2C+S%2E%2C+and+Kuhn%2C+J%2E+%282018%29%2E+German+Radio+Interviews%3A+The+GRAIN+release+of+the+SFB732+silver+s)
21. Stutterheim, C. v. and Klein, W. (1989). Referential movement in descriptive and narrative discourse. In Rainer Dietrich et al., editors, Language Processing in Social Context, pages 39–76. North Holland, Amsterdam. [find](https://scholar.google.com/scholar?q=Stutterheim%2C+C%2E+v%2E+and+Klein%2C+W%2E+%281989%29%2E+Referential+movement+in+descriptive+and+narrative+discourse%2E+In+Rainer+Dietrich+et+al%2E%2C+editors%2C+Language+Processing+in+Social+Context%2C+pages+39%E2%80%9376%2E+North+Holl)
22. van Kuppevelt, J. (1995). Discourse structure, topicality and questioning. Journal of Linguistics, 31:109–149. [find](https://scholar.google.com/scholar?q=van+Kuppevelt%2C+J%2E+%281995%29%2E+Discourse+structure%2C+topicality+and+questioning%2E+Journal+of+Linguistics%2C+31%3A109%E2%80%93149%2E)
23. Velleman, L. and Beaver, D. (2016). Question-based models of information structure. In Caroline Féry et al., editors, The Oxford Handbook of Information Structure, pages 86–107. Oxford University Press. [find](https://scholar.google.com/scholar?q=Velleman%2C+L%2E+and+Beaver%2C+D%2E+%282016%29%2E+Question%2Dbased+models+of+information+structure%2E+In+Caroline+Fe%CC%81ry+et+al%2E%2C+editors%2C+The+Oxford+Handbook+of+Information+Structure%2C+pages+86%E2%80%93107%2E+Oxford+University+Pre)
24. Yimam, S. M., Gurevych, I., Eckart de Castilho, R., and Biemann, C. (2013). WebAnno: A flexible, web-based and visually supported system for distributed annotations. In Proceedings of the 51 st Annual Meeting of the Association for Computational Linguistics: System Demonstrations, pages 1–6, Sofia. [find](https://scholar.google.com/scholar?q=Yimam%2C+S%2E+M%2E%2C+Gurevych%2C+I%2E%2C+Eckart+de+Castilho%2C+R%2E%2C+and+Biemann%2C+C%2E+%282013%29%2E+WebAnno%3A+A+flexible%2C+web%2Dbased+and+visually+supported+system+for+distributed+annotations%2E+In+Proceedings+of+the+51+st+Annual)