[Mova](https://md.mova.elamur.ai/free/en/) · [this page in HTML](https://mova.elamur.ai/free/en/docs/papers/aclbulk-1995-collins-prepositional-phrase-attachment-through-backed/) [home](https://md.mova.elamur.ai/free/en/) / [docs](https://md.mova.elamur.ai/free/en/docs/) / [papers](https://md.mova.elamur.ai/free/en/docs/papers/) / [English](https://md.mova.elamur.ai/free/en/docs/papers/en/) / Prepositional Phrase Attachment through a Backed-off Model # Prepositional Phrase Attachment through a Backed-off Model **Authors:** [Michael Collins](https://md.mova.elamur.ai/free/en/docs/papers/authors/michael-collins/) and James Brooks · **Year:** 1995 · **Venue:** Third Workshop on Very Large Corpora **Link:** [aclanthology.org/W95-0103](https://aclanthology.org/W95-0103/) · **Licence:** [CC BY-NC-SA 3.0](https://creativecommons.org/licenses/by-nc-sa/3.0/) — summary only [**166** citations](https://openalex.org/works?filter=cites:W1601728146) openalex · 2026-10-19[**68** citations in our library](https://md.mova.elamur.ai/free/en/docs/papers/cited-by/aclbulk-1995-collins-prepositional-phrase-attachment-through-backed/) of the 140673 papers whose bibliographies we read[Third Workshop on Very Large Corpora](https://aclanthology.org/volumes/W95-01/)[licence](https://creativecommons.org/licenses/by-nc-sa/3.0/) - [Publisher's page](https://aclanthology.org/W95-0103/) - [PDF](https://aclanthology.org/W95-0103.pdf) - [DOI 10.1007/978-94-017-2390-9_11](https://doi.org/10.1007/978-94-017-2390-9_11) - [OpenAlex](https://openalex.org/W1601728146) **Authors (2)** 1. [Michael Collins](https://openalex.org/A5079061237) [ORCID](https://orcid.org/0000-0003-0997-1527) · [Semantic Scholar](https://www.semanticscholar.org/author/143707112) · h 60 · 22998 citations · 244 works 2. James Brooks [Semantic Scholar](https://www.semanticscholar.org/author/2067634566) Citations and author metrics from openalex (2026-10-19); authors with the same name are not always told apart. ## What it is about The paper treats the choice between noun and verb attachment of a prepositional phrase as a language-modeling problem. Each case is a quadruple of verb, first noun, preposition and second noun, taken from Wall Street Journal verb phrases in the IBM split (20,801 training, 3,097 test, 4,039 development). The method is the backed-off estimate used in n-gram speech models: it uses the full four-word counts when they are large enough, and backs off to triples and pairs when they are not, with a count threshold at each level. It reaches 84.5% accuracy on the test set. Ignoring any event seen fewer than five times drops it to 81.6%, which the authors read as evidence that low counts matter. A human given only the four head words is at about 88%. ## Ideas - I1. PP-attachment probe in `en`: extract the quadruples from the `en` parse of EWT test, score attachments with a backed-off count model, and compare with the gold attachments; this tells how many of the `en` errors are PP attachment errors and whether a count model would fix them (test only; the WSJ split itself is NC). - I2. Back-off features in the perceptron: add the backoff stage (which of the verb-preposition, noun-preposition or full counts exist, bucketed) as features in `en/src/parse.rs`, and measure LAS on EWT test against the current 80.24. - I3. Count threshold check on the lexicon: test whether removing rare-word features in `en/src/ptag.rs` hurts ATIS and EWT differently, which is the paper's low-count claim transferred to tagging. ## For Mova The code is `en/src/parse.rs` (features) and the `en parse-eval` command for the probe. The chapters are [22. Phrases: noun, adjective, adverb and prepositional phrases](https://md.mova.elamur.ai/free/en/docs/languages/en/22-phrases/) (what a PP attaches to) and `23-complementation.md`. Measure first: the share of EWT test errors that are PP attachments, using the quadruple extraction; that count decides whether the idea is worth building. ## Cite The paper itself, not this card. BibTeX from the library's record of the work. [DOI 10.1007/978-94-017-2390-9_11](https://doi.org/10.1007/978-94-017-2390-9_11) ``` @inproceedings{collins1995prepositional, title = {{Prepositional Phrase Attachment through a Backed-off Model}}, author = {Collins, Michael and Brooks, James}, booktitle = {Third Workshop on Very Large Corpora}, year = {1995}, doi = {10.1007/978-94-017-2390-9\_11}, url = {https://doi.org/10.1007/978-94-017-2390-9_11} } ``` - [← previous A Maximum Entropy Model for Prepositional Phrase Attachment](https://md.mova.elamur.ai/free/en/docs/papers/aclbulk-1994-ratnaparkhi-maximum-entropy-model-prepositional-phrase/) - [next → Corpus Statistics Meet the Noun Compound: Some Empirical Results](https://md.mova.elamur.ai/free/en/docs/papers/aclbulk-1995-lauer-corpus-statistics-meet-noun-compound/) - [↑ back to English](https://md.mova.elamur.ai/free/en/docs/papers/en/) ## References 4 references, 1 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet. 1. W. Gale and K. Church. Poor Estimates of Context are Worse than None. ht Proceedings of the June 1990 DARPA Speech and Natural L~mguage Workshop, ftidden Valley, Pennsylva.nia. [find](https://scholar.google.com/scholar?q=W%2E+Gale+and+K%2E+Church%2E+Poor+Estimates+of+Context+are+Worse+than+None%2E+ht+Proceedings+of+the+June+1990+DARPA+Speech+and+Natural+L%7Emguage+Workshop%2C+ftidden+Valley%2C+Pennsylva%2Enia%2E) 2. Daniel Karp, Yves Scha,bes, Martin Zaidel and Dania Egedi. A Freely Available Wide Coverage Morphological Analyzer for English. In Proceedings of the 15th, International Conference on Computational Li'nguistics, 1994. D. IIindle and M. Rooth. Structural Ambiguity and Lexical Relations. Computational Linguistics , 19(1):103-120, 1993. [find](https://scholar.google.com/scholar?q=Daniel+Karp%2C+Yves+Scha%2Cbes%2C+Martin+Zaidel+and+Dania+Egedi%2E+A+Freely+Available+Wide+Coverage+Morphological+Analyzer+for+English%2E+In+Proceedings+of+the+15th%2C+International+Conference+on+Computational+Li) 3. S. Katz. Estima.tion of Probabilities fi:om Sparse Data for the Language Model Component of a. Speech Recogniser. IEEE Transaetion,s on Acoustics, Speech, and Signal Processing, Vol. ASSP-35, No. 3, 1987. [find](https://scholar.google.com/scholar?q=S%2E+Katz%2E+Estima%2Etion+of+Probabilities+fi%3Aom+Sparse+Data+for+the+Language+Model+Component+of+a%2E+Speech+Recogniser%2E+IEEE+Transaetion%2Cs+on+Acoustics%2C+Speech%2C+and+Signal+Processing%2C+Vol%2E+ASSP%2D35%2C+No%2E+3%2C+1) 4. M. Marcus, B. Santorini and M. Marcinkiewicz. Building a Large Annotated Corpus of English: the Penn Treebank. Computational Linguistics, 19(2), 1993. A. Ratnaparkhi, J. Reyna.r and S. Roukos. A Maximum Entropy Model for Prepositional Phrase Attachment. In Proceeding s of the A R P A Workshop on Human Language Technology, Plainsboro, N J, March 1994. [RRR941 [find](https://scholar.google.com/scholar?q=M%2E+Marcus%2C+B%2E+Santorini+and+M%2E+Marcinkiewicz%2E+Building+a+Large+Annotated+Corpus+of+English%3A+the+Penn+Treebank%2E+Computational+Linguistics%2C+19%282%29%2C+1993%2E+A%2E+Ratnaparkhi%2C+J%2E+Reyna%2Er+and+S%2E+Roukos%2E+A+Maxim) [our card](https://md.mova.elamur.ai/free/en/docs/papers/bank-1993-marcus-building-large-annotated-corpus-english/)