[Mova](https://md.mova.elamur.ai/free/en/) · [this page in HTML](https://mova.elamur.ai/free/en/docs/papers/enprag-2019-marneffe-commitmentbank-investigating-projection-naturally/)

[home](https://md.mova.elamur.ai/free/en/) / [docs](https://md.mova.elamur.ai/free/en/docs/) / [papers](https://md.mova.elamur.ai/free/en/docs/papers/) / [English](https://md.mova.elamur.ai/free/en/docs/papers/en/) / The CommitmentBank: Investigating projection in naturally occurring discourse

# The CommitmentBank: Investigating projection in naturally occurring discourse

**Authors:** [Marie-Catherine de Marneffe](https://md.mova.elamur.ai/free/en/docs/papers/authors/marie-catherine-de-marneffe/), Mandy Simons, [Judith Tonhauser](https://md.mova.elamur.ai/free/en/docs/papers/authors/judith-tonhauser/) · **Year:** 2019 · **Venue:** Proceedings of Sinn und Bedeutung 23, vol. 2, pp. 107–124 **Link:** [ojs.ub.uni-konstanz.de/sub/index.php/sub/article/view/601](https://ojs.ub.uni-konstanz.de/sub/index.php/sub/article/view/601) · **Licence:** [CC BY 4.0](https://creativecommons.org/licenses/by/4.0/) (Proceedings of Sinn und Bedeutung)

[**176** citations](https://openalex.org/works?filter=cites:W3026404337) openalex-snapshot · 2026-10-14[**234** citations in our library](https://md.mova.elamur.ai/free/en/docs/papers/cited-by/enprag-2019-marneffe-commitmentbank-investigating-projection-naturally/) of the 140673 papers whose bibliographies we read[Proceedings of Sinn und Bedeutung 23 (2019), vol. 2, pp. 107–124](https://openalex.org/S4306523482)[licence](https://creativecommons.org/licenses/by/4.0/)

- [Publisher's page](https://doi.org/10.18148/sub/2019.v23i2.601)
- [PDF](https://ojs.ub.uni-konstanz.de/sub/index.php/sub/article/download/601/456)
- [DOI 10.18148/sub/2019.v23i2.601](https://doi.org/10.18148/sub/2019.v23i2.601)
- [OpenAlex](https://openalex.org/W3026404337)

**Authors (3)**

1. [Marie-Catherine de Marneffe](https://openalex.org/A5112862689) h 31 · 8612 citations · 82 works
2. [Mandy Simons](https://openalex.org/A5043812758) [ORCID](https://orcid.org/0000-0001-6260-6102) · h 20 · 3009 citations · 53 works
3. [Judith Tonhauser](https://openalex.org/A5015826409) [ORCID](https://orcid.org/0000-0002-6061-7120) · h 23 · 2466 citations · 98 works

Citations and author metrics from openalex-snapshot (2026-10-14); authors with the same name are not always told apart.

## What it is about

The paper builds a corpus of 1,200 naturally occurring discourses, from the Wall Street Journal, the fiction part of the BNC and Switchboard dialogue. In each one, the last sentence has a clause-embedding predicate (such as "know", "think", "tell") under negation, a modal, a question or a conditional, and the question is whether the speaker is still committed to the content of the complement. The workers on Mechanical Turk (at least eight per item) answered on a scale from -3 (speaker is certain the complement is false) to +3 (certain it is true), and 982 epistemic-modal items with 45 predicates remain for the analysis. The factive/nonfactive split explains some of the variance (a coefficient of 1.60 for factivity, with a Nagelkerke R² of 0.126), but the predicate lemma explains more (R² 0.228). Subject person (0.124), tense (0.078) and genre (0.062) add little alone, and all factors together reach R² 0.35. Context-only plausibility, from 558 items, explains very little (R² 0.036). The main finding is that projection is gradient and item-specific, so the factive class is a weak predictor on its own.

## Ideas

- I1. A projection score for complements in `prag`. For each clause complement (UD `ccomp`, `csubj`) of a predicate under negation, a question, a modal or a conditional, compute a commitment value on the paper's -3 to +3 scale from the lexical and structural features, and store it with the explanation (which feature gave what). Measure the rank correlation with teacher ratings on open dialogue and tales, by two-fold `cv`. The teacher is Opus and only labels; the score must come from Rust.
- I2. A predicate table with projection rates per lemma. The paper's result is that the lemma beats the factive class, so `en` could hold, for each clause-taking verb, a learned mean and spread, with the factive class as the default for unseen lemmas. Learn the table only from the teacher labels on open text (not from the CommitmentBank itself, because the corpus is not ours to build with), and test on held-out lemmas.
- I3. Person and tense as slot features. The paper finds that a first-person subject lowers the commitment for most predicates, and that the effect interacts with tense (Figures 4 and 5). Add `subject_person` and `predicate_tense` as slots in `prag/src/feats.rs`, and run the SLM with and without them. Report the ablation (remove the slot, measure the change), and keep the slot only if the drop is larger than the run-to-run spread.
- I4. A negative control from context. The paper shows that the plausibility from the preceding context hardly predicts the score. Mova can check the same thing on its own tales: a complement that the story already states should project more, and a complement that the story never mentions should not. If the context does not change the score, the world is not being used, and that is a bug to report.

## For Mova

Chapters: [33. Implicature and presupposition](https://md.mova.elamur.ai/free/en/docs/languages/en/33-implicature-and-presupposition/) (projection and presupposition), [27. Negation](https://md.mova.elamur.ai/free/en/docs/languages/en/27-negation/) (the negated embedding), [26. Questions](https://md.mova.elamur.ai/free/en/docs/languages/en/26-questions/) (complements under a question), and [31. Speech acts](https://md.mova.elamur.ai/free/en/docs/languages/en/31-speech-acts/) (commitment). Code: `prag/src/feats.rs`, `prag/src/lens.rs`, the narration frames in `world/src/story.rs` (a complement becomes a claim of the speaker in a frame, not a fact of the main line), `en/src/parse.rs` for the complement clauses. Licence note: the paper is CC BY 4.0, so short quotes with the citation are fine. The CommitmentBank data is a separate resource on GitHub, and its licence has to be checked before any use. Until then, treat it as a test set only.

Topics: [Discourse analysis](https://md.mova.elamur.ai/free/en/docs/papers/topics/discourse-analysis/)

## Cite

The paper itself, not this card. BibTeX from the library's record of the work. [DOI 10.18148/sub/2019.v23i2.601](https://doi.org/10.18148/sub/2019.v23i2.601)

```
@inproceedings{marneffe2019commitmentbank,
  title = {{The CommitmentBank: Investigating projection in naturally occurring discourse}},
  author = {Marneffe, Marie-Catherine de and Simons, Mandy and Tonhauser, Judith},
  booktitle = {Proceedings of Sinn und Bedeutung 23 (2019), vol. 2, pp. 107–124},
  year = {2019},
  doi = {10.18148/sub/2019.v23i2.601},
  url = {https://doi.org/10.18148/sub/2019.v23i2.601}
}
```

- [← previous VARD 2: A tool for dealing with spelling variation in historical corpora](https://md.mova.elamur.ai/free/en/docs/papers/enprag-2008-baron-vard2-tool-dealing-spelling-variation/)
- [next → Rhetorical Structure Theory: Toward a functional theory of text organization](https://md.mova.elamur.ai/free/en/docs/papers/enud-1988-mann-rhetorical-structure-theory-functional/)
- [↑ back to English](https://md.mova.elamur.ai/free/en/docs/papers/en/)

## References

16 references, 2 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Anand, P. and V. Hacquard (2014). Factivity, belief and discourse. In The Art and Craft of Semantics: A Festschrift for Irene Heim, pp. 69–90. Cambridge, MA: MIT Working Papers in Linguistics. [find](https://scholar.google.com/scholar?q=Anand%2C+P%2E+and+V%2E+Hacquard+%282014%29%2E+Factivity%2C+belief+and+discourse%2E+In+The+Art+and+Craft+of+Semantics%3A+A+Festschrift+for+Irene+Heim%2C+pp%2E+69%E2%80%9390%2E+Cambridge%2C+MA%3A+MIT+Working+Papers+in+Linguistics%2E)
2. Beaver, D. (2010). Have you noticed that your belly button lint colour is related to the colour of your clothing? In R. Bäuerle, U. Reyle, and T. E. Zimmermann (Eds.), Presuppositions and Discourse: Essays Offered to Hans Kamp, pp. 65–99. Leiden, The Netherlands: Brill. [find](https://scholar.google.com/scholar?q=Beaver%2C+D%2E+%282010%29%2E+Have+you+noticed+that+your+belly+button+lint+colour+is+related+to+the+colour+of+your+clothing%3F+In+R%2E+Ba%CC%88uerle%2C+U%2E+Reyle%2C+and+T%2E+E%2E+Zimmermann+%28Eds%2E%29%2C+Presuppositions+and+Discourse%3A+)
3. Chierchia, G. and S. McConnell-Ginet (1990). Meaning and Grammar. Cambridge, MA: MIT Press. [find](https://scholar.google.com/scholar?q=Chierchia%2C+G%2E+and+S%2E+McConnell%2DGinet+%281990%29%2E+Meaning+and+Grammar%2E+Cambridge%2C+MA%3A+MIT+Press%2E)
4. Christensen, R. H. B. (2018). “ordinal”: Regression models for ordinal data. R package version 2018.8-25. [http://www.cran.r-project.org/package=ordinal/](http://www.cran.r-project.org/package=ordinal/). de Marneffe, M.-C., B. MacCartney, and C. D. Manning (2006). Generating typed dependency parses from phrase structure parses. In Proceedings of the 5th International Conference on Language Resources and Evaluation, pp. 449–454. [↗](http://www.cran.r-project.org/package=ordinal/) [our card](https://md.mova.elamur.ai/free/en/docs/papers/map-2006-marneffe-generating-typed-dependency-parses-phrase/)
5. Gazdar, G. (1979). A solution to the projection problem. In C.-K. Oh and D. A. Dinneen (Eds.), Syntax and Semantics, Volume 11: Presupposition, pp. 57–89. New York: Academic Press. [↗](https://doi.org/10.1163/9789004368880_003)
6. Heim, I. (1983). On the projection problem for presuppositions. In M. Barlow, D. Flickinger, and M. Westcoat (Eds.), West Coast Conference on Formal Linguistics 2, pp. 114–125. [find](https://scholar.google.com/scholar?q=Heim%2C+I%2E+%281983%29%2E+On+the+projection+problem+for+presuppositions%2E+In+M%2E+Barlow%2C+D%2E+Flickinger%2C+and+M%2E+Westcoat+%28Eds%2E%29%2C+West+Coast+Conference+on+Formal+Linguistics+2%2C+pp%2E+114%E2%80%93125%2E)
7. Karttunen, L. (1971). Some observations on factivity. Papers in Linguistics 4, 55–69. [↗](https://doi.org/10.1080/08351817109370248)
8. Kiparsky, P. and C. Kiparsky (1970). Fact. In M. Bierwisch and K. E. Heidolph (Eds.), Progress in linguistics, pp. 143–173. The Hague, Paris: Mouton. [find](https://scholar.google.com/scholar?q=Kiparsky%2C+P%2E+and+C%2E+Kiparsky+%281970%29%2E+Fact%2E+In+M%2E+Bierwisch+and+K%2E+E%2E+Heidolph+%28Eds%2E%29%2C+Progress+in+linguistics%2C+pp%2E+143%E2%80%93173%2E+The+Hague%2C+Paris%3A+Mouton%2E)
9. Klein, D. and C. D. Manning (2003). Accurate unlexicalized parsing. In Proceedings of the 41st Meeting of the Association of Computational Linguistics, pp. 423–430. [find](https://scholar.google.com/scholar?q=Klein%2C+D%2E+and+C%2E+D%2E+Manning+%282003%29%2E+Accurate+unlexicalized+parsing%2E+In+Proceedings+of+the+41st+Meeting+of+the+Association+of+Computational+Linguistics%2C+pp%2E+423%E2%80%93430%2E) [our card](https://md.mova.elamur.ai/free/en/docs/papers/aclbulk-2003-klein-accurate-unlexicalized-parsing/)
10. R Development Core Team (2016). R: A Language and Environment for Statistical Computing. Vienna, Austria: R Foundation for Statistical Computing. [find](https://scholar.google.com/scholar?q=R+Development+Core+Team+%282016%29%2E+R%3A+A+Language+and+Environment+for+Statistical+Computing%2E+Vienna%2C+Austria%3A+R+Foundation+for+Statistical+Computing%2E)
11. Schlenker, P. (2010). Local contexts and local meanings. Philosophical Studies 151, 115–142. [↗](https://doi.org/10.1007/s11098-010-9586-0)
12. Simons, M. (2007). Observations on embedding verbs, evidentiality, and presupposition. Lingua 117(6), 1034–1056. [↗](https://doi.org/10.1016/j.lingua.2006.05.006)
13. Smith, E. A. S. and K. C. Hall (2014). The relationship between projection and embedding environment. In 48th Annual Meeting of the Chicago Linguistic Society, Volume 48(1), pp. 563–578. [find](https://scholar.google.com/scholar?q=Smith%2C+E%2E+A%2E+S%2E+and+K%2E+C%2E+Hall+%282014%29%2E+The+relationship+between+projection+and+embedding+environment%2E+In+48th+Annual+Meeting+of+the+Chicago+Linguistic+Society%2C+Volume+48%281%29%2C+pp%2E+563%E2%80%93578%2E)
14. Stalnaker, R. C. (1974). Pragmatic presuppositions. In M. Munitz and P. Unger (Eds.), Semantics and Philosophy, pp. 197–213. New York: New York University Press. [find](https://scholar.google.com/scholar?q=Stalnaker%2C+R%2E+C%2E+%281974%29%2E+Pragmatic+presuppositions%2E+In+M%2E+Munitz+and+P%2E+Unger+%28Eds%2E%29%2C+Semantics+and+Philosophy%2C+pp%2E+197%E2%80%93213%2E+New+York%3A+New+York+University+Press%2E)
15. Tonhauser, J. (2016). Prosodic cues to presupposition projection. Semantics and Linguistic Theory 26, 934–960. [↗](https://doi.org/10.3765/salt.v26i0.3788)
16. Tonhauser, J., D. Beaver, and J. Degen (2018). How projective is projective content? Gradience in projectivity and at-issueness. Journal of Semantics 35, 495–542. van der Sandt, R. (1992). Presupposition projection as anaphora resolution. Journal of Semantics 9, 333–377. [find](https://scholar.google.com/scholar?q=Tonhauser%2C+J%2E%2C+D%2E+Beaver%2C+and+J%2E+Degen+%282018%29%2E+How+projective+is+projective+content%3F+Gradience+in+projectivity+and+at%2Dissueness%2E+Journal+of+Semantics+35%2C+495%E2%80%93542%2E+van+der+Sandt%2C+R%2E+%281992%29%2E+Presupposit)