[Mova](https://md.mova.elamur.ai/free/en/) · [this page in HTML](https://mova.elamur.ai/free/en/docs/papers/aclbulk-2011-tsarfaty-evaluating-dependency-parsing-robust-heuristics/)

[home](https://md.mova.elamur.ai/free/en/) / [docs](https://md.mova.elamur.ai/free/en/docs/) / [papers](https://md.mova.elamur.ai/free/en/docs/papers/) / [English](https://md.mova.elamur.ai/free/en/docs/papers/en/) / Evaluating Dependency Parsing: Robust and Heuristics-Free Cross-Annotation Evaluation

# Evaluating Dependency Parsing: Robust and Heuristics-Free Cross-Annotation Evaluation

**Authors:** [Reut Tsarfaty](https://md.mova.elamur.ai/free/en/docs/papers/authors/reut-tsarfaty/), [Joakim Nivre](https://md.mova.elamur.ai/free/en/docs/papers/authors/joakim-nivre/), Evelina Andersson · **Year:** 2011 · **Venue:** Proceedings of the 2011 Conference on Empirical Methods in Natural Language Processing **Link:** [aclanthology.org/D11-1036](https://aclanthology.org/D11-1036/) · **Licence:** [CC BY-NC-SA 3.0](https://creativecommons.org/licenses/by-nc-sa/3.0/) — summary only

[**28** citations](https://openalex.org/works?filter=cites:W2151651070) openalex · 2026-10-18[**19** citations in our library](https://md.mova.elamur.ai/free/en/docs/papers/cited-by/aclbulk-2011-tsarfaty-evaluating-dependency-parsing-robust-heuristics/) of the 140673 papers whose bibliographies we read[Proceedings of the 2011 Conference on Empirical Methods in Natural Language Processing](https://aclanthology.org/volumes/D11-1/)[licence](https://creativecommons.org/licenses/by-nc-sa/3.0/)

- [Publisher's page](https://aclanthology.org/D11-1036/)
- [PDF](https://aclanthology.org/D11-1036.pdf)
- [OpenAlex](https://openalex.org/W2151651070)

**Authors (3)**

1. [Reut Tsarfaty](https://openalex.org/A5063283689) [ORCID](https://orcid.org/0000-0001-6406-6568) · h 24 · 2886 citations · 217 works
2. [Joakim Nivre](https://openalex.org/A5077063699) h 60 · 16290 citations · 335 works
3. [Evelina Andersson](https://openalex.org/A5050539703) h 3 · 70 citations · 5 works

Citations and author metrics from openalex (2026-10-18); authors with the same name are not always told apart.

## What it is about

Attachment scores compare parsers only within one treebank scheme. Two parsers trained on different conversions of the Penn Treebank can differ mainly because of annotation choices, such as the head of a prepositional phrase or of a copula. The authors propose TEDEVAL: each dependency tree is mapped by deterministic unification steps into a common functional tree, the mapped trees are generalized to remove scheme-specific choices, and a tree edit distance scores the hypothesis against one or several gold standards. For different conversions of the Penn Treebank, the ranking of parsers seen with LAS changes or disappears once the outputs are normalized. The paper's conclusion is that a score difference across experiments can be a difference in annotation, not in parsing.

## Ideas

- I1. `en parse-eval`: report a normalized tree-distance score over the `mova` dialect next to LAS for EWT, ATIS and GENTLE (GUM test only); measure how often the ranking of two `en` models changes between the two scores.
- I2. `tools/parsecmp`: compare the witnesses (Stanza, Trankit, spaCy) with the normalized score instead of raw LAS, and measure how many ranking pairs change on EWT test.
- I3. `en/src/convert.rs`: define the harmonisation steps as the normal form of the `mova` dialect, and measure how many arcs the normal form changes per treebank, so that cross-treebank claims in `docs/` use normalized scores.

## For Mova

Touches [08. National varieties](https://md.mova.elamur.ai/free/en/docs/languages/en/08-national-varieties/) and [20. Syntax: the Universal Dependencies frame](https://md.mova.elamur.ai/free/en/docs/languages/en/20-syntax-overview/). The paper gives a principled answer to the question why Mova's cross-treebank numbers (ATIS 63.0, GENTLE 67.9) are not directly comparable with other systems. Measure I1 first on the existing outputs.

Topics: [Dependency parsing](https://md.mova.elamur.ai/free/en/docs/papers/topics/dependency-parsing/) · [Treebanks](https://md.mova.elamur.ai/free/en/docs/papers/topics/treebanks/)

## Cite

The paper itself, not this card. BibTeX from the library's record of the work.

```
@inproceedings{tsarfaty2011evaluating,
  title = {{Evaluating Dependency Parsing: Robust and Heuristics-Free Cross-Annotation Evaluation}},
  author = {Tsarfaty, Reut and Nivre, Joakim and Andersson, Evelina},
  booktitle = {Proceedings of the 2011 Conference on Empirical Methods in Natural Language Processing},
  year = {2011},
  url = {https://aclanthology.org/D11-1036/}
}
```

- [← previous A Gold Standard Corpus of Early Modern German](https://md.mova.elamur.ai/free/en/docs/papers/aclbulk-2011-scheible-gold-standard-corpus-early-modern/)
- [next → Automatic Detection and Correction of Errors in Dependency Treebanks](https://md.mova.elamur.ai/free/en/docs/papers/aclbulk-2011-volokh-automatic-detection-correction-errors-dependency/)
- [↑ back to English](https://md.mova.elamur.ai/free/en/docs/papers/en/)

## References

36 references, 12 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Philip Bille. 2005. A survey on tree edit distance and related. problems. Theoretical Computer Science, 337:217–239. [find](https://scholar.google.com/scholar?q=Philip+Bille%2E+2005%2E+A+survey+on+tree+edit+distance+and+related%2E+problems%2E+Theoretical+Computer+Science%2C+337%3A217%E2%80%93239%2E)
2. Ezra Black, Steven P. Abney, D. Flickenger, Claudia Gdaniec, Ralph Grishman, P. Harrison, Donald Hindle, Robert Ingria, Frederick Jelinek, Judith L. Klavans, Mark Liberman, Mitchell P. Marcus, Salim Roukos, Beatrice Santorini, and Tomek Strzalkowski. 1991. Procedure for quantitatively comparing the syntactic coverage of English grammars. In E. Black, editor, Proceedings of the workshop on Speech and Natural Language, HLT, pages 306–311. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Ezra+Black%2C+Steven+P%2E+Abney%2C+D%2E+Flickenger%2C+Claudia+Gdaniec%2C+Ralph+Grishman%2C+P%2E+Harrison%2C+Donald+Hindle%2C+Robert+Ingria%2C+Frederick+Jelinek%2C+Judith+L%2E+Klavans%2C+Mark+Liberman%2C+Mitchell+P%2E+Marcus%2C+Salim+R)
3. Ted Briscoe, John Carroll, Jonathan Graham, and Ann Copestake. 2002. Relational evaluation schemes. In Proceedings of LREC Workshop“Beyond Parseval – Towards improved evaluation measures for parsing systems”. [find](https://scholar.google.com/scholar?q=Ted+Briscoe%2C+John+Carroll%2C+Jonathan+Graham%2C+and+Ann+Copestake%2E+2002%2E+Relational+evaluation+schemes%2E+In+Proceedings+of+LREC+Workshop%E2%80%9CBeyond+Parseval+%E2%80%93+Towards+improved+evaluation+measures+for+parsing+s)
4. Sabine Buchholz and Erwin Marsi. 2006. CoNLL-X shared task on multilingual dependency parsing. In Proceedings of CoNLL-X, pages 149–164. [find](https://scholar.google.com/scholar?q=Sabine+Buchholz+and+Erwin+Marsi%2E+2006%2E+CoNLL%2DX+shared+task+on+multilingual+dependency+parsing%2E+In+Proceedings+of+CoNLL%2DX%2C+pages+149%E2%80%93164%2E) [our card](https://md.mova.elamur.ai/free/en/docs/papers/parsers-2006-buchholz-conll-x-shared-task-multilingual/)
5. Ekaterina Buyko and Udo Hahn. 2010. Evaluating the impact of alternative dependency graph encodings on solving event extraction tasks. In Proceedings of EMNLP, pages 982–992. [find](https://scholar.google.com/scholar?q=Ekaterina+Buyko+and+Udo+Hahn%2E+2010%2E+Evaluating+the+impact+of+alternative+dependency+graph+encodings+on+solving+event+extraction+tasks%2E+In+Proceedings+of+EMNLP%2C+pages+982%E2%80%93992%2E)
6. John Carroll, Ted Briscoe, and Antonio Sanfilippo. 1998. Parser evaluation: a survey and a new proposal. In Proceedings of LREC, pages 447–454. [find](https://scholar.google.com/scholar?q=John+Carroll%2C+Ted+Briscoe%2C+and+Antonio+Sanfilippo%2E+1998%2E+Parser+evaluation%3A+a+survey+and+a+new+proposal%2E+In+Proceedings+of+LREC%2C+pages+447%E2%80%93454%2E)
7. Daniel Cer, Marie-Catherine de Marneffe, Daniel Jurafsky, and Christopher D. Manning. 2010. Parsing to stanford dependencies: Trade-offs between speed and accuracy. In Proceedings of LREC. [find](https://scholar.google.com/scholar?q=Daniel+Cer%2C+Marie%2DCatherine+de+Marneffe%2C+Daniel+Jurafsky%2C+and+Christopher+D%2E+Manning%2E+2010%2E+Parsing+to+stanford+dependencies%3A+Trade%2Doffs+between+speed+and+accuracy%2E+In+Proceedings+of+LREC%2E) [our card](https://md.mova.elamur.ai/free/en/docs/papers/bank-2010-cer-parsing-stanford-dependencies-trade-offs/)
8. Jinho D. Choi and Martha Palmer. 2010. Robust constituent-to-dependency conversion for English. In Proceedings of TLT. [find](https://scholar.google.com/scholar?q=Jinho+D%2E+Choi+and+Martha+Palmer%2E+2010%2E+Robust+constituent%2Dto%2Ddependency+conversion+for+English%2E+In+Proceedings+of+TLT%2E)
9. Paul Cohen. 1995. Empirical Methods for Artificial Intelligence. The MIT Press. [find](https://scholar.google.com/scholar?q=Paul+Cohen%2E+1995%2E+Empirical+Methods+for+Artificial+Intelligence%2E+The+MIT+Press%2E)
10. Marie-Catherine de Marneffe, Bill MacCartney, and Christopher D. Manning. 2006. Generating typed dependency parses from phrase structure parses. In Proceedings of LREC, pages 449–454. [find](https://scholar.google.com/scholar?q=Marie%2DCatherine+de+Marneffe%2C+Bill+MacCartney%2C+and+Christopher+D%2E+Manning%2E+2006%2E+Generating+typed+dependency+parses+from+phrase+structure+parses%2E+In+Proceedings+of+LREC%2C+pages+449%E2%80%93454%2E) [our card](https://md.mova.elamur.ai/free/en/docs/papers/map-2006-marneffe-generating-typed-dependency-parses-phrase/)
11. Martin Emms. 2008. Tree-distance and some other variants of evalb. In Proceedings of LREC. [find](https://scholar.google.com/scholar?q=Martin+Emms%2E+2008%2E+Tree%2Ddistance+and+some+other+variants+of+evalb%2E+In+Proceedings+of+LREC%2E) [our card](https://md.mova.elamur.ai/free/en/docs/papers/lingbulk-2008-emms-tree-distance-some-other-variants/)
12. Erhard Hinrichs, Sandra Kübler, Karin Naumann, Heike Telljohan, and Julia Trushkina. 2004. Recent development in linguistic annotations of the TüBa-D/Z Treebank. In Proceedings of TLT. [find](https://scholar.google.com/scholar?q=Erhard+Hinrichs%2C+Sandra+Ku%CC%88bler%2C+Karin+Naumann%2C+Heike+Telljohan%2C+and+Julia+Trushkina%2E+2004%2E+Recent+development+in+linguistic+annotations+of+the+Tu%CC%88Ba%2DD%2FZ+Treebank%2E+In+Proceedings+of+TLT%2E)
13. Richard Johansson and Pierre Nugues. 2007. Extended constituent-to-dependency conversion for English. In Proceedings of NODALIDA. [find](https://scholar.google.com/scholar?q=Richard+Johansson+and+Pierre+Nugues%2E+2007%2E+Extended+constituent%2Dto%2Ddependency+conversion+for+English%2E+In+Proceedings+of+NODALIDA%2E) [our card](https://md.mova.elamur.ai/free/en/docs/papers/map-2007-johansson-extended-constituent-dependency-conversion-english/)
14. Sandra Kübler and Heike Telljohann. 2002. Towards a dependency-oriented evaluation for partial parsing. In Proceedings of LREC Workshop“Beyond Parseval – Towards improved evaluation measures for parsing systems”. [find](https://scholar.google.com/scholar?q=Sandra+Ku%CC%88bler+and+Heike+Telljohann%2E+2002%2E+Towards+a+dependency%2Doriented+evaluation+for+partial+parsing%2E+In+Proceedings+of+LREC+Workshop%E2%80%9CBeyond+Parseval+%E2%80%93+Towards+improved+evaluation+measures+for+pars)
15. Sandra Kübler, Ryan McDonald, and Joakim Nivre. 2009. Dependency Parsing. Number 2 in Synthesis Lectures on Human Language Technologies. Morgan & Claypool Publishers. [find](https://scholar.google.com/scholar?q=Sandra+Ku%CC%88bler%2C+Ryan+McDonald%2C+and+Joakim+Nivre%2E+2009%2E+Dependency+Parsing%2E+Number+2+in+Synthesis+Lectures+on+Human+Language+Technologies%2E+Morgan+%26+Claypool+Publishers%2E)
16. Mitchell P. Marcus, Beatrice Santorini, and Mary Ann Marcinkiewicz. 1993. Building a large annotated corpus of English: The Penn Treebank. Computational Linguistics, 19:313–330. [find](https://scholar.google.com/scholar?q=Mitchell+P%2E+Marcus%2C+Beatrice+Santorini%2C+and+Mary+Ann+Marcinkiewicz%2E+1993%2E+Building+a+large+annotated+corpus+of+English%3A+The+Penn+Treebank%2E+Computational+Linguistics%2C+19%3A313%E2%80%93330%2E) [our card](https://md.mova.elamur.ai/free/en/docs/papers/bank-1993-marcus-building-large-annotated-corpus-english/)
17. Ryan McDonald and Fernando Pereira. 2006. Online learning of approximate dependency parsing algorithms. In Proceedings of EACL, pages 81–88. [find](https://scholar.google.com/scholar?q=Ryan+McDonald+and+Fernando+Pereira%2E+2006%2E+Online+learning+of+approximate+dependency+parsing+algorithms%2E+In+Proceedings+of+EACL%2C+pages+81%E2%80%9388%2E) [our card](https://md.mova.elamur.ai/free/en/docs/papers/continual-2006-mcdonald-online-learning-approximate-dependency-parsing/)
18. Ryan McDonald, Koby Crammer, and Fernando Pereira. 2005. Online large-margin training of dependency parsers. In Proceedings of ACL, pages 91–98. [find](https://scholar.google.com/scholar?q=Ryan+McDonald%2C+Koby+Crammer%2C+and+Fernando+Pereira%2E+2005%2E+Online+large%2Dmargin+training+of+dependency+parsers%2E+In+Proceedings+of+ACL%2C+pages+91%E2%80%9398%2E) [our card](https://md.mova.elamur.ai/free/en/docs/papers/narrative-2005-mcdonald-online-large-margin-training-dependency/)
19. Igor Mel’čuk. 1988. Dependency Syntax: Theory and Practice. State University of New York Press. [find](https://scholar.google.com/scholar?q=Igor+Mel%E2%80%99c%CC%8Cuk%2E+1988%2E+Dependency+Syntax%3A+Theory+and+Practice%2E+State+University+of+New+York+Press%2E)
20. Yusuke Miyao, Rune Sætre, Kenji Sagae, Takuya Matsuzaki, and Jun’ichi Tsujii. 2008. Task-oriented evaluation of syntactic parsers and their representations. In Proceedings of ACL, pages 46–54. [find](https://scholar.google.com/scholar?q=Yusuke+Miyao%2C+Rune+S%C3%A6tre%2C+Kenji+Sagae%2C+Takuya+Matsuzaki%2C+and+Jun%E2%80%99ichi+Tsujii%2E+2008%2E+Task%2Doriented+evaluation+of+syntactic+parsers+and+their+representations%2E+In+Proceedings+of+ACL%2C+pages+46%E2%80%9354%2E) [our card](https://md.mova.elamur.ai/free/en/docs/papers/aclbulk-2008-miyao-task-oriented-evaluation-syntactic-parsers/)
21. Joakim Nivre and Beata Megyesi. 2007. Bootstrapping a Swedish Treebank using cross-corpus harmonization and annotation projection. In Proceedings of TLT. [find](https://scholar.google.com/scholar?q=Joakim+Nivre+and+Beata+Megyesi%2E+2007%2E+Bootstrapping+a+Swedish+Treebank+using+cross%2Dcorpus+harmonization+and+annotation+projection%2E+In+Proceedings+of+TLT%2E)
22. Joakim Nivre and Jens Nilsson. 2005. Pseudo projective dependency parsing. In Proceeding of ACL, pages 99– 106. [find](https://scholar.google.com/scholar?q=Joakim+Nivre+and+Jens+Nilsson%2E+2005%2E+Pseudo+projective+dependency+parsing%2E+In+Proceeding+of+ACL%2C+pages+99%E2%80%93+106%2E)
23. Joakim Nivre and Mario Scholz. 2004. Deterministic dependency parsing of English text. In Proceedings of COLING, pages 64–70. [find](https://scholar.google.com/scholar?q=Joakim+Nivre+and+Mario+Scholz%2E+2004%2E+Deterministic+dependency+parsing+of+English+text%2E+In+Proceedings+of+COLING%2C+pages+64%E2%80%9370%2E) [our card](https://md.mova.elamur.ai/free/en/docs/papers/aclbulk-2004-nivre-deterministic-dependency-parsing-english-text/)
24. Joakim Nivre, Johan Hall, Sandra Kübler, Ryan McDonald, Jens Nilsson, Sebastian Riedel, and Deniz Yuret. 2007a. [find](https://scholar.google.com/scholar?q=Joakim+Nivre%2C+Johan+Hall%2C+Sandra+Ku%CC%88bler%2C+Ryan+McDonald%2C+Jens+Nilsson%2C+Sebastian+Riedel%2C+and+Deniz+Yuret%2E+2007a%2E)
25. The CoNLL 2007 shared task on dependency parsing. In Proceedings of the CoNLL Shared Task Session of EMNLP-CoNLL 2007, pages 915–932. [find](https://scholar.google.com/scholar?q=The+CoNLL+2007+shared+task+on+dependency+parsing%2E+In+Proceedings+of+the+CoNLL+Shared+Task+Session+of+EMNLP%2DCoNLL+2007%2C+pages+915%E2%80%93932%2E)
26. Joakim Nivre, Jens Nilsson, Johan Hall, Atanas Chanev, Gülsen Eryigit, Sandra Kübler, Svetoslav Marinov, and Erwin Marsi. 2007b. Maltparser: A language-independent system for data-driven dependency parsing. Natural Language Engineering, 13(1):1–41. [find](https://scholar.google.com/scholar?q=Joakim+Nivre%2C+Jens+Nilsson%2C+Johan+Hall%2C+Atanas+Chanev%2C+Gu%CC%88lsen+Eryigit%2C+Sandra+Ku%CC%88bler%2C+Svetoslav+Marinov%2C+and+Erwin+Marsi%2E+2007b%2E+Maltparser%3A+A+language%2Dindependent+system+for+data%2Ddriven+dependency+)
27. Joakim Nivre, Laura Rimell, Ryan McDonald, and Carlos Gómez-Rodrı́guez. 2010. Evaluation of dependency parsers on unbounded dependencies. pages 813–821. [find](https://scholar.google.com/scholar?q=Joakim+Nivre%2C+Laura+Rimell%2C+Ryan+McDonald%2C+and+Carlos+Go%CC%81mez%2DRodr%C4%B1%CC%81guez%2E+2010%2E+Evaluation+of+dependency+parsers+on+unbounded+dependencies%2E+pages+813%E2%80%93821%2E) [our card](https://md.mova.elamur.ai/free/en/docs/papers/aclbulk-2010-nivre-evaluation-dependency-parsers-unbounded-dependencies/)
28. Owen Rambow. 2010. The Simple Truth about Dependency and Phrase Structure Representations: An Opinion Piece. In Proceedings of HLT-ACL, pages 337– 340. [find](https://scholar.google.com/scholar?q=Owen+Rambow%2E+2010%2E+The+Simple+Truth+about+Dependency+and+Phrase+Structure+Representations%3A+An+Opinion+Piece%2E+In+Proceedings+of+HLT%2DACL%2C+pages+337%E2%80%93+340%2E)
29. Ines Rehbein and Josef van Genabith. 2007. Why is it so difficult to compare treebanks? Tiger and TüBa-D/Z revisited. In Proceedings of TLT, pages 115–126. [find](https://scholar.google.com/scholar?q=Ines+Rehbein+and+Josef+van+Genabith%2E+2007%2E+Why+is+it+so+difficult+to+compare+treebanks%3F+Tiger+and+Tu%CC%88Ba%2DD%2FZ+revisited%2E+In+Proceedings+of+TLT%2C+pages+115%E2%80%93126%2E)
30. Brian Roark. 2002. Evaluating parser accuracy using edit distance. In Proceedings of LREC Workshop“Beyond Parseval – Towards improved evaluation measures for parsing systems”. [find](https://scholar.google.com/scholar?q=Brian+Roark%2E+2002%2E+Evaluating+parser+accuracy+using+edit+distance%2E+In+Proceedings+of+LREC+Workshop%E2%80%9CBeyond+Parseval+%E2%80%93+Towards+improved+evaluation+measures+for+parsing+systems%E2%80%9D%2E)
31. Roy Schwartz, Omri Abend, Roi Reichart, and Ari Rappoport. 2011. Neutralizing linguistically problematic annotations in unsupervised dependency parsing evaluation. In Proceedings of ACL, pages 663–672. [find](https://scholar.google.com/scholar?q=Roy+Schwartz%2C+Omri+Abend%2C+Roi+Reichart%2C+and+Ari+Rappoport%2E+2011%2E+Neutralizing+linguistically+problematic+annotations+in+unsupervised+dependency+parsing+evaluation%2E+In+Proceedings+of+ACL%2C+pages+663%E2%80%93672)
32. Stuart M. Shieber. 1986. An Introduction to Unification-Based Grammars. Center for the Study of Language and Information. [find](https://scholar.google.com/scholar?q=Stuart+M%2E+Shieber%2E+1986%2E+An+Introduction+to+Unification%2DBased+Grammars%2E+Center+for+the+Study+of+Language+and+Information%2E)
33. Wojciech Skut, Brigitte Krenn, Thorsten Brants, and Hans Uszkoreit. 1997. An annotation scheme for free word-order languages. In Proceedings of the fifth conference on Applied natural language processing, pages 88–95. [find](https://scholar.google.com/scholar?q=Wojciech+Skut%2C+Brigitte+Krenn%2C+Thorsten+Brants%2C+and+Hans+Uszkoreit%2E+1997%2E+An+annotation+scheme+for+free+word%2Dorder+languages%2E+In+Proceedings+of+the+fifth+conference+on+Applied+natural+language+process)
34. Hiroyasu Yamada and Yuji Matsumoto. 2003. Statistical dependency analysis with support vector machines. In Proceeding of IWPT, pages 195–206. [find](https://scholar.google.com/scholar?q=Hiroyasu+Yamada+and+Yuji+Matsumoto%2E+2003%2E+Statistical+dependency+analysis+with+support+vector+machines%2E+In+Proceeding+of+IWPT%2C+pages+195%E2%80%93206%2E) [our card](https://md.mova.elamur.ai/free/en/docs/papers/parsers-2003-yamada-statistical-dependency-analysis-support-vector/)
35. Kaizhong Zhang and Dennis Shasha. 1989. Simple fast algorithms for the editing distance between trees and related problems. In SIAM Journal of Computing, volume 18, pages 1245–1262. [find](https://scholar.google.com/scholar?q=Kaizhong+Zhang+and+Dennis+Shasha%2E+1989%2E+Simple+fast+algorithms+for+the+editing+distance+between+trees+and+related+problems%2E+In+SIAM+Journal+of+Computing%2C+volume+18%2C+pages+1245%E2%80%931262%2E)
36. Arnold M. Zwicky. 1993. Heads, bases, and functors. In G.G. Corbett, N. Fraser, and S. McGlashan, editors, Heads in Grammatical Theory, pages 292–315. Cambridge University Press. [find](https://scholar.google.com/scholar?q=Arnold+M%2E+Zwicky%2E+1993%2E+Heads%2C+bases%2C+and+functors%2E+In+G%2EG%2E+Corbett%2C+N%2E+Fraser%2C+and+S%2E+McGlashan%2C+editors%2C+Heads+in+Grammatical+Theory%2C+pages+292%E2%80%93315%2E+Cambridge+University+Press%2E)