[Mova](https://md.mova.elamur.ai/free/en/) · [this page in HTML](https://mova.elamur.ai/free/en/docs/papers/ud-2023-liu-data-driven-parsing-evaluation-child/)

[home](https://md.mova.elamur.ai/free/en/) / [docs](https://md.mova.elamur.ai/free/en/docs/) / [papers](https://md.mova.elamur.ai/free/en/docs/papers/) / [English](https://md.mova.elamur.ai/free/en/docs/papers/en/) / Data-driven Parsing Evaluation for Child-Parent Interactions

# Data-driven Parsing Evaluation for Child-Parent Interactions

**Authors:** [Zoey Liu](https://md.mova.elamur.ai/free/en/docs/papers/authors/zoey-liu/), [Emily Prud'hommeaux](https://md.mova.elamur.ai/free/en/docs/papers/authors/emily-prud-hommeaux/) · **Year:** 2023 · **Venue:** Transactions of the Association for Computational Linguistics (TACL) **Link:** [aclanthology.org/2023.tacl-1.97](https://aclanthology.org/2023.tacl-1.97/) · **Licence:** [CC BY 4.0](https://creativecommons.org/licenses/by/4.0/)

[**3** citations](https://openalex.org/works?filter=cites:W4390075409) openalex · 2026-10-18[**6** citations in our library](https://md.mova.elamur.ai/free/en/docs/papers/cited-by/ud-2023-liu-data-driven-parsing-evaluation-child/) of the 140673 papers whose bibliographies we read[Transactions of the Association for Computational Linguistics](https://aclanthology.org/volumes/2023.tacl-1/)[licence](https://creativecommons.org/licenses/by/4.0/)

- [Publisher's page](https://aclanthology.org/2023.tacl-1.97/)
- [PDF](https://aclanthology.org/2023.tacl-1.97.pdf)
- [DOI 10.1162/tacl_a_00624](https://doi.org/10.1162/tacl_a_00624)
- [arXiv 2209.13778](https://arxiv.org/abs/2209.13778)
- [OpenAlex](https://openalex.org/W4390075409)

**Authors (2)**

1. [Zoey Liu](https://openalex.org/A5063501461) [ORCID](https://orcid.org/0009-0008-5313-157X) · h 8 · 232 citations · 44 works
2. [Emily Prud'hommeaux](https://openalex.org/A5085014772) h 17 · 856 citations · 103 works

Citations and author metrics from openalex (2026-10-18); authors with the same name are not always told apart.

## What it is about

The authors build a UD-style treebank of spoken child-parent interactions from CHILDES: 44,744 utterances and 233,907 words from 10 children aged 18 to 66 months. Their guidelines extend UD for speech repairs, restarts, repetition and other spoken structures. Three parsers (Diaparser, MaChamp, UUParser) are trained on written out-of-domain data: EWT, Tweebank and ESL. The best out-of-domain parsers reach LAS of about 83.9 on parent data (ESL, twitter language model) and about 79.4 on child data. LAS for child data rises with age, mostly between 18 and 48 months, and the effect of utterance length is small and negative. In-domain training helps a little.

## Ideas

- I1. `en parse-eval` on the child and parent utterances split by age band (18–24, 24–48, 48+ months), for the current perceptron parser, as the first parser baseline on this treebank (test only).
- I2. `en/src/parse.rs`: the paper's finding that small, informal training data (Tweebank) beats larger treebanks is a test for Mova's training-data choice; train on EWT, ESLSpok and CHILDES train splits in turn and compare LAS on this set.
- I3. `en` parse-eval report: LAS against utterance length, to check the paper's weak negative effect on Mova's own output.

## For Mova

This is a second CHILDES treebank with its own guidelines, useful as an out-of-domain test of `en` for child speech. The age curve is a result about the input that Mova's parser may also show. Relevant chapters are `languages/en/21-clause-structure` and `38-dialogue-and-discourse-markers`. Measure first the LAS of `en` by age band on this treebank, with the parent and child halves reported separately.

Topics: [Treebanks](https://md.mova.elamur.ai/free/en/docs/papers/topics/treebanks/)

## Cite

The paper itself, not this card. BibTeX from the library's record of the work. [DOI 10.1162/tacl_a_00624](https://doi.org/10.1162/tacl_a_00624) · [arXiv 2209.13778](https://arxiv.org/abs/2209.13778)

```
@article{liu2023data,
  title = {{Data-driven Parsing Evaluation for Child-Parent Interactions}},
  author = {Liu, Zoey and Prud'hommeaux, Emily},
  journal = {Transactions of the Association for Computational Linguistics},
  year = {2023},
  doi = {10.1162/tacl\_a\_00624},
  eprint = {2209.13778},
  archivePrefix = {arXiv},
  url = {https://doi.org/10.1162/tacl_a_00624}
}
```

- [← previous Difficulties in Handling Mathematical Expressions in Universal Dependencies](https://md.mova.elamur.ai/free/en/docs/papers/ud-2023-levine-difficulties-handling-mathematical-expressions-universal/)
- [next → Fitting Fixed Expressions into the UD Mould: Swedish as a Use Case](https://md.mova.elamur.ai/free/en/docs/papers/ud-2024-ahrenberg-fitting-fixed-expressions-into-ud/)
- [↑ back to English](https://md.mova.elamur.ai/free/en/docs/papers/en/)

## References

60 references, 12 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Thierry Bazillon, Melanie Deplano, Frederic Bechet, Alexis Nasr, and Benoit Favre. 2012. Syntactic annotation of spontaneous speech: Application to call-center conversation data. In Proceedings of the Eighth International Conference on Language Resources and Evaluation (LREC’12), pages 1338–1342, Istanbul, Turkey. European Language Resources Association (ELRA). [find](https://scholar.google.com/scholar?q=Thierry+Bazillon%2C+Melanie+Deplano%2C+Frederic+Bechet%2C+Alexis+Nasr%2C+and+Benoit+Favre%2E+2012%2E+Syntactic+annotation+of+spontaneous+speech%3A+Application+to+call%2Dcenter+conversation+data%2E+In+Proceedings+of+the)
2. Mark Anderson, Anders Søgaard, and Carlos Gómez-Rodrı́guez. 2021. Replicating and extending ‘‘Because their treebanks leak’’: Graph Frederic Bechet, Alexis Nasr, and Benoit Favre. 2014. Adapting dependency parsing to spontaneous speech for open domain spoken language We would like to thank our TACL action editor, Afra Alishahi, as well as the anonymous reviewers for their thoughtful feedback. We would also like to thank Parker Robbins for his efforts in the initial round of annotations. understanding. In Fifteenth Annual Conference of the International Speech Communication Association. https://doi.org/10.21437/Interspeech.2014-39 [↗](https://doi.org/10.21437/Interspeech.2014-39)
3. Ruth A. Berman. 1990. On acquiring an (S)VO language: Subjectless sentences in children’s Hebrew. Linguistics, 28(6):1135–1166. https://doi.org/10.1515/ling.1990 .28.6.1135 Hong Kong, China. Association for Computational Linguistics. https://doi.org/10 .18653/v1/D19-1162 [↗](https://doi.org/10.1515/ling.1990) [our card](https://md.mova.elamur.ai/free/en/docs/papers/ud-2019-davidson-dependency-parsing-spoken-dialog-systems/)
4. Katherine Demuth, Jennifer Culbertson, and Jennifer Alter. 2006. Word-minimality, epenthesis and coda licensing in the early acquisition of English. Language and Speech, 49(2):137–173. https://doi.org/10.1177/00238309060490020201, PubMed: 17037120 [↗](https://doi.org/10.1177/00238309060490020201)
5. Yevgeni Berzak, Jessica Kenney, Carolyn Spadine, Jing Xian Wang, Lucia Lam, Keiko Sophie Mori, Sebastian Garza, and Boris Katz. 2016. Universal Dependencies for learner English. In Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 737–746. Association for Computational Linguistics. https://doi.org/10 .18653/v1/P16-1070 [↗](https://aclanthology.org/P16-1070/) [our card](https://md.mova.elamur.ai/free/en/docs/papers/berzak-2016-universal-dependencies-learner-english/)
6. Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2018. BERT: Pre-training of deep bidirectional transformers for language understanding. CoRR, abs/1810.04805. [↗](https://arxiv.org/abs/1810.04805)
7. Anouck Braggaar and Rob van der Goot. 2021. Challenges in annotating and parsing spoken, code-switched, Frisian-Dutch data. In Proceedings of the Second Workshop on Domain Adaptation for NLP, pages 50–58, Kyiv, Ukraine. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Anouck+Braggaar+and+Rob+van+der+Goot%2E+2021%2E+Challenges+in+annotating+and+parsing+spoken%2C+code%2Dswitched%2C+Frisian%2DDutch+data%2E+In+Proceedings+of+the+Second+Workshop+on+Domain+Adaptation+for+NLP%2C+pages+50)
8. Kaja Dobrovoljc and Matej Martinc. 2018. Er . . . well, it matters, right? On the role of data representations in spoken language dependency parsing. In Proceedings of the Second Workshop on Universal Dependencies (UDW 2018), pages 37–46, Brussels, Belgium. Association for Computational Linguistics. https:// doi.org/10.18653/v1/W18-6005 [↗](https://doi.org/10.18653/v1/w18-6005)
9. Susan R. Braunwald. 1985. The development of connectives. Journal of Pragmatics, 9(4):513–525. https://doi.org/10 .1016/0378-2166(85)90019-0 [↗](https://doi.org/10)
10. Roger Brown. 1973. A First Language: The Early Stages. Harvard University Press. https://doi.org/10.4159/harvard .9780674732469 [↗](https://doi.org/10.4159/harvard)
11. Sabine Buchholz and Erwin Marsi. 2006. CoNLL-X shared task on multilingual dependency parsing. In Proceedings of the Tenth Conference on Computational Natural Language Learning (CoNLL-X), pages 149–164, New York City. Association for Computational Linguistics. https://doi.org/10.3115/1596276.1596305 [↗](https://doi.org/10.3115/1596276.1596305) [our card](https://md.mova.elamur.ai/free/en/docs/papers/parsers-2006-buchholz-conll-x-shared-task-multilingual/)
12. Sam Davidson, Dian Yu, and Zhou Yu. 2019. Dependency parsing for spoken dialog systems. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), pages 1513–1519, Kaja Dobrovoljc. 2022. Spoken language treebanks in Universal Dependencies: An overview. In Proceedings of the 13th Language Resources and Evaluation Conference, pages 1798–1806, Marseille, France. European Language Resources Association. [find](https://scholar.google.com/scholar?q=Sam+Davidson%2C+Dian+Yu%2C+and+Zhou+Yu%2E+2019%2E+Dependency+parsing+for+spoken+dialog+systems%2E+In+Proceedings+of+the+2019+Conference+on+Empirical+Methods+in+Natural+Language+Processing+and+the+9th+Internatio) [our card](https://md.mova.elamur.ai/free/en/docs/papers/ud-2019-davidson-dependency-parsing-spoken-dialog-systems/)
13. Kaja Dobrovoljc and Joakim Nivre. 2016a. The Universal Dependencies treebank of spoken Slovenian. In Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC’16), pages 1566–1573, Portorož, Slovenia. European Language Resources Association (ELRA). [find](https://scholar.google.com/scholar?q=Kaja+Dobrovoljc+and+Joakim+Nivre%2E+2016a%2E+The+Universal+Dependencies+treebank+of+spoken+Slovenian%2E+In+Proceedings+of+the+Tenth+International+Conference+on+Language+Resources+and+Evaluation+%28LREC%E2%80%9916%29%2C+p)
14. Kaja Dobrovoljc and Joakim Nivre. 2016b. The Universal Dependencies treebank of spoken Slovenian. In Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC’16), pages 1566–1573, Portorož, Slovenia. European Language Resources Association (ELRA). [find](https://scholar.google.com/scholar?q=Kaja+Dobrovoljc+and+Joakim+Nivre%2E+2016b%2E+The+Universal+Dependencies+treebank+of+spoken+Slovenian%2E+In+Proceedings+of+the+Tenth+International+Conference+on+Language+Resources+and+Evaluation+%28LREC%E2%80%9916%29%2C+p)
15. Fernanda Ferreira and Karl G. D. Bailey. 2004. Disfluencies and human language comprehension. Trends in Cognitive Sciences, 8(5):231–237. https://doi.org/10.1016/j.tics.2004 .03.011, PubMed: 15120682 [↗](https://doi.org/10.1016/j.tics.2004)
16. Kim Gerdes and Sylvain Kahane. 2009. Speaking in piles: Paradigmatic annotation of French spoken corpus. In Fifth Corpus Linguistics Conference, pages 1–15, Liverpool, United Kingdom. [find](https://scholar.google.com/scholar?q=Kim+Gerdes+and+Sylvain+Kahane%2E+2009%2E+Speaking+in+piles%3A+Paradigmatic+annotation+of+French+spoken+corpus%2E+In+Fifth+Corpus+Linguistics+Conference%2C+pages+1%E2%80%9315%2C+Liverpool%2C+United+Kingdom%2E)
17. John J. Godfrey, Edward C. Holliman, and Jane McDaniel. 1992. Switchboard: Telephone speech corpus for research and development. In Acoustics, Speech, and Signal Processing, IEEE International Conference on, volume 1, pages 517–520. IEEE Computer Society. https://doi.org/10.1109/ICASSP.1992 .225858 [↗](https://doi.org/10.1109/icassp.1992)
18. Rob van der Goot, Ahmet Üstün, Alan Ramponi, Ibrahim Sharaf, and Barbara Plank. 2021. Massive choice, ample tasks (MaChAmp): A toolkit for multi-task learning in NLP. In Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics: System Demonstrations, pages 176–197, Online. Association for Computational Linguistics. https://doi.org/10.18653/v1/2021.eacl-demos.22 [↗](https://doi.org/10.18653/v1/2021.eacl-demos.22)
19. Shai Gretz, Alon Itai, Brian MacWhinney, Bracha Nir, and Shuly Wintner. 2013. Parsing Hebrew CHILDES transcripts. Language Resources and Evaluation, 49(1):107–145. https://doi.org/10.1007/s10579-013-9256-x Ruifang He, Yaru Wang, Dawei Song, Peng Zhang, Yuan Jia, and Aijun Li. 2018. A dependency parser for spontaneous Chinese spoken language. ACM Transactions on Asian and Low-Resource Language Information Processing, 17(4):1–13. https://doi .org/10.1145/3196278 [↗](https://doi.org/10.1007/s10579-013-9256-x)
20. Mary Hughes and Shanley Allen. 2006. A discourse-pragmatic analysis of subject omission in child English. In Proceedings of the 30th Annual Boston University Conference on Language Development, volume 1, pages 293–304. Cascadilla Press, Somerville, MA. [find](https://scholar.google.com/scholar?q=Mary+Hughes+and+Shanley+Allen%2E+2006%2E+A+discourse%2Dpragmatic+analysis+of+subject+omission+in+child+English%2E+In+Proceedings+of+the+30th+Annual+Boston+University+Conference+on+Language+Development%2C+volume)
21. Sylvain Kahane, Bernard Caron, Emmett Strickland, and Kim Gerdes. 2021. Annotation guidelines of UD and SUD treebanks for spoken corpora: A proposal. In Proceedings of the 20th International Workshop on Treebanks and Linguistic Theories (TLT, SyntaxFest 2021), pages 35–47, Sofia, Bulgaria. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Sylvain+Kahane%2C+Bernard+Caron%2C+Emmett+Strickland%2C+and+Kim+Gerdes%2E+2021%2E+Annotation+guidelines+of+UD+and+SUD+treebanks+for+spoken+corpora%3A+A+proposal%2E+In+Proceedings+of+the+20th+International+Workshop+) [our card](https://md.mova.elamur.ai/free/en/docs/papers/ud-2021-kahane-annotation-guidelines-ud-sud-treebanks/)
22. Liubov Kovriguina, Ivan Shilin, Alina Putintseva, and Alexander Shipilo. 2018. Multilevel annotation in the corpus for parsing Russian spontaneous speech. In Speech and Computer, pages 311–320, Cham. Springer International Publishing. https://doi.org/10.1007/978-3-319-99579-3_33 [↗](https://doi.org/10.1007/978-3-319-99579-3_33)
23. Stan A. Kuczaj II. 1977. The acquisition of regular and irregular past tense forms. Journal of Verbal Learning and Verbal Behavior, 16(5):589–600. https://doi.org /10.1016/S0022-5371(77)80021-2 [↗](https://doi.org/10.1016/s0022-5371(77)80021-2)
24. John Lee, Herman Leung, and Keying Li. 2017. Towards Universal Dependencies for learner Chinese. In Proceedings of the NoDaLiDa 2017 Workshop on Universal Dependencies (UDW 2017), pages 67–71, Gothenburg, Sweden. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=John+Lee%2C+Herman+Leung%2C+and+Keying+Li%2E+2017%2E+Towards+Universal+Dependencies+for+learner+Chinese%2E+In+Proceedings+of+the+NoDaLiDa+2017+Workshop+on+Universal+Dependencies+%28UDW+2017%29%2C+pages+67%E2%80%9371%2C+Gothenb)
25. Miryam de Lhoneux, Sara Stymne, and Joakim Nivre. 2017. Arc-hybrid non-projective dependency parsing with a static-dynamic oracle. In Proceedings of the The 15th International Conference on Parsing Technologies (IWPT). Pisa, Italy. [find](https://scholar.google.com/scholar?q=Miryam+de+Lhoneux%2C+Sara+Stymne%2C+and+Joakim+Nivre%2E+2017%2E+Arc%2Dhybrid+non%2Dprojective+dependency+parsing+with+a+static%2Ddynamic+oracle%2E+In+Proceedings+of+the+The+15th+International+Conference+on+Parsing+Te)
26. Elena Lieven, Dorothé Salomo, and Michael Tomasello. 2009. Two-year-old children’s production of multiword utterances: A usage-based analysis. Cognitive Linguistics, 20(3):481–508. https://doi.org/10.1515/COGL.2009 .022 [↗](https://doi.org/10.1515/cogl.2009)
27. Yijia Liu, Yi Zhu, Wanxiang Che, Bing Qin, Nathan Schneider, and Noah A. Smith. 2018. Parsing tweets into Universal Dependencies. In Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers), pages 965–975, New Orleans, Louisiana. Association for Computational Linguistics. https:// doi.org/10.18653/v1/N18-1088 [↗](https://doi.org/10.18653/v1/n18-1088) [our card](https://md.mova.elamur.ai/free/en/docs/papers/ud-2018-liu-parsing-tweets-into-universal-dependencies/)
28. Yinhan Liu, Myle Ott, Naman Goyal, Jingfei Du, Mandar Joshi, Danqi Chen, Omer Levy, Mike Lewis, Luke Zettlemoyer, and Veselin Stoyanov. 2019. Roberta: A robustly optimized BERT pretraining approach. CoRR, abs/1907.11692. [↗](https://arxiv.org/abs/1907.11692)
29. Zoey Liu and Emily Prud’hommeaux. 2021. Dependency parsing evaluation for low-resource spontaneous speech. In Proceedings of the Second Workshop on Domain Adaptation for NLP, pages 156–165, Kyiv, Ukraine. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Zoey+Liu+and+Emily+Prud%E2%80%99hommeaux%2E+2021%2E+Dependency+parsing+evaluation+for+low%2Dresource+spontaneous+speech%2E+In+Proceedings+of+the+Second+Workshop+on+Domain+Adaptation+for+NLP%2C+pages+156%E2%80%93165%2C+Kyiv%2C+Ukra) [our card](https://md.mova.elamur.ai/free/en/docs/papers/ud-2021-liu-dependency-parsing-evaluation-low-resource/)
30. Zoey Liu and Stefanie Wulff. 2023. The development of dependency length minimization in early child language: A case study of the dative alternation. In Proceedings of the Seventh International Conference on Dependency Linguistics (Depling, GURT/SyntaxFest 2023), pages 1–8, Washington, D.C. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Zoey+Liu+and+Stefanie+Wulff%2E+2023%2E+The+development+of+dependency+length+minimization+in+early+child+language%3A+A+case+study+of+the+dative+alternation%2E+In+Proceedings+of+the+Seventh+International+Confer)
31. Xiaofei Lu. 2009. Automatic measurement of syntactic complexity in child language acquisition. International Journal of Corpus Linguistics, 14(1):3–28. https://doi.org/10.1075/ijcl.14.1.02lu Shannon Lubetich and Kenji Sagae. 2014. Data-driven measurement of child language development with simple syntactic templates. In Proceedings of COLING 2014, the 25th International Conference on Computational Linguistics: Technical Papers, pages 2151–2160, Dublin, Ireland. Dublin City University and Association for Computational Linguistics. [↗](https://doi.org/10.1075/ijcl.14.1.02lu)
32. Brian MacWhinney. 2000. The CHILDES Project: Tools for Analyzing Talk. Transcription Format and Programs, volume 1, Psychology Press. [find](https://scholar.google.com/scholar?q=Brian+MacWhinney%2E+2000%2E+The+CHILDES+Project%3A+Tools+for+Analyzing+Talk%2E+Transcription+Format+and+Programs%2C+volume+1%2C+Psychology+Press%2E)
33. Ryan McDonald and Joakim Nivre. 2011. Analyzing and integrating Dependency Parsers. Computational Linguistics, 37(1):197–230. https://doi.org/10.1162/colia00039 [↗](https://doi.org/10.1162/colia00039)
34. Marie Mikulová, Jiřı́ Mı́rovský, Anja Nedoluzhko, Petr Pajas, Jan Štěpánek, and Jan Hajič. 2017. Pdtsc 2.0 - Spoken corpus with rich multi-layer structural annotation. In Text, Speech, and Dialogue, pages 129–137, Cham. Springer International Publishing. https://doi.org/10.1007/978-3-319-64206-2_15 [↗](https://doi.org/10.1007/978-3-319-64206-2_15)
35. Tim Miller. 2009a. Improved syntactic models for parsing speech with repairs. In Proceedings of Human Language Technologies: The 2009 Annual Conference of the North American Chapter of the Association for Computational Linguistics, pages 656–664, Boulder, Colorado. Association for Computational Linguistics. https://doi.org/10 .3115/1620754.1620850 [↗](https://doi.org/10)
36. Tim Miller. 2009b. Word buffering models for improved speech repair parsing. In Proceedings of the 2009 Conference on Empirical Methods in Natural Language Processing, pages 737–745, Singapore. Association for Computational Linguistics. https://doi.org/10.3115/1699571.1699609 [↗](https://doi.org/10.3115/1699571.1699609)
37. Tim Miller and William Schuler. 2008. A unified syntactic model for parsing fluent and disfluent speech. In Proceedings of the 46th Annual Meeting of the Association for Computational Linguistics on Human Language Technologies: Short Papers, pages 105–108, Columbus, Ohio. Association for Computational Linguistics. https://doi.org/10 .3115/1557690.1557718 [↗](https://doi.org/10)
38. Susanne Miyata, Kenji Sagae, and Brian MacWhinney. 2013. The syntax parser GRASP for CHILDES (in Japanese). Journal of Health and Medical Science, 3:45–62. [find](https://scholar.google.com/scholar?q=Susanne+Miyata%2C+Kenji+Sagae%2C+and+Brian+MacWhinney%2E+2013%2E+The+syntax+parser+GRASP+for+CHILDES+%28in+Japanese%29%2E+Journal+of+Health+and+Medical+Science%2C+3%3A45%E2%80%9362%2E)
39. Joakim Nivre, Johan Hall, Sandra Kübler, Ryan McDonald, Jens Nilsson, Sebastian Riedel, and Deniz Yuret. 2007. [find](https://scholar.google.com/scholar?q=Joakim+Nivre%2C+Johan+Hall%2C+Sandra+Ku%CC%88bler%2C+Ryan+McDonald%2C+Jens+Nilsson%2C+Sebastian+Riedel%2C+and+Deniz+Yuret%2E+2007%2E)
40. The CoNLL 2007 shared task on dependency parsing. In Proceedings of the 2007 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning (EMNLP-CoNLL), pages 915–932, Prague, Czech Republic. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=The+CoNLL+2007+shared+task+on+dependency+parsing%2E+In+Proceedings+of+the+2007+Joint+Conference+on+Empirical+Methods+in+Natural+Language+Processing+and+Computational+Natural+Language+Learning+%28EMNLP%2DCoN)
41. Tomohiro Ohno, Shigeki Matsubara, Nobuo Kawaguchi, and Yasuyoshi Inagaki. 2005. Robust dependency parsing of spontaneous Japanese spoken language. IEICE Transactions on Information and Systems, E88-D(3): 545–552. https://doi.org/10.1093/ietisy/e88-d.3.545 [↗](https://doi.org/10.1093/ietisy/e88-d.3.545)
42. Niko Partanen, Rogier Blokland, KyungTae Lim, Thierry Poibeau, and Michael Rießler. 2018. The first Komi-Zyrian Universal Dependencies treebanks. In Proceedings of the Second Workshop on Universal Dependencies (UDW 2018), pages 126–132, Brussels, Belgium. Association for Computational Linguistics. https:// doi.org/10.18653/v1/W18-6015 [↗](https://doi.org/10.18653/v1/w18-6015)
43. Peng Qi, Yuhao Zhang, Yuhui Zhang, Jason Bolton, and Christopher D. Manning. 2020. Stanza: A Python natural language processing toolkit for many human languages. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics: System Demonstrations, pages 101–108, Online. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Peng+Qi%2C+Yuhao+Zhang%2C+Yuhui+Zhang%2C+Jason+Bolton%2C+and+Christopher+D%2E+Manning%2E+2020%2E+Stanza%3A+A+Python+natural+language+processing+toolkit+for+many+human+languages%2E+In+Proceedings+of+the+58th+Annual+Meet) [our card](https://md.mova.elamur.ai/free/en/docs/papers/ud-2020-qi-stanza-python-natural-language-processing/)
44. Mohammad Sadegh Rasooli and Joel Tetreault. 2013. Joint parsing and disfluency detection in linear time. In Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing, pages 124–129, Seattle, Washington, USA. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Mohammad+Sadegh+Rasooli+and+Joel+Tetreault%2E+2013%2E+Joint+parsing+and+disfluency+detection+in+linear+time%2E+In+Proceedings+of+the+2013+Conference+on+Empirical+Methods+in+Natural+Language+Processing%2C+page)
45. Kenji Sagae, Eric Davis, Alon Lavie, Brian MacWhinney, and Shuly Wintner. 2007. High-accuracy annotation and parsing of CHILDES transcripts. In Proceedings of the Workshop on Cognitive Aspects of Computational Language Acquisition, pages 25–32, Prague, Czech Republic. Association for Computational Linguistics. https://doi.org/10.3115/1629795.1629799 [↗](https://doi.org/10.3115/1629795.1629799)
46. Kenji Sagae, Eric Davis, Alon Lavie, Brian Macwhinney, and Shuly Wintner. 2010. Morphosyntactic annotation of CHILDES transcripts. Journal of Child Language, 37(3):705–729. https://doi.org/10 .1017/S0305000909990407, PubMed: 20334720 [↗](https://doi.org/10)
47. Kenji Sagae, Alon Lavie, and Brian MacWhinney. 2001. Parsing the CHILDES database: Methodology and lessons learned. In Proceedings of the Seventh International Workshop on Parsing Technologies, pages 166–176, Beijing, China. [find](https://scholar.google.com/scholar?q=Kenji+Sagae%2C+Alon+Lavie%2C+and+Brian+MacWhinney%2E+2001%2E+Parsing+the+CHILDES+database%3A+Methodology+and+lessons+learned%2E+In+Proceedings+of+the+Seventh+International+Workshop+on+Parsing+Technologies%2C+pages+)
48. Kenji Sagae, Alon Lavie, and Brian MacWhinney. 2005. Automatic measurement of syntactic development in child language. In Proceedings of the 43rd Annual Meeting of the Association for Computational Linguistics (ACL’05), pages 197–204, Ann Arbor, Michigan. Association for Computational Linguistics. https://doi.org/10.3115/1219840.1219865 [↗](https://doi.org/10.3115/1219840.1219865)
49. Kenji Sagae, Brian MacWhinney, and Alon Lavie. 2004. Adding syntactic annotations to transcripts of parent-child dialogs. In Proceedings of the Fourth International Conference on Language Resources and Evaluation (LREC’04), Lisbon, Portugal. European Language Resources Association (ELRA). [↗](https://doi.org/10.63317/4gbqq9vir6xj)
50. Alessandro Sanchez, Stephan C. Meylan, Mika Braginsky, KyleE.MacDonald, Daniel Yurovsky, and Michael C. Frank. 2019. childes-db: A flexible and reproducible interface to the child language data exchange system. Behavior Research Methods, 51(4):1928–1941. https:// doi.org/10.3758/s13428-018-1176-7, PubMed: 30623390 [↗](https://doi.org/10.3758/s13428-018-1176-7)
51. Beatrice Santorini. 1990. Part-of-speech tagging guidelines for the Penn Treebank Project. University of Pennsylvania, School of Engineering and Applied Science. [find](https://scholar.google.com/scholar?q=Beatrice+Santorini%2E+1990%2E+Part%2Dof%2Dspeech+tagging+guidelines+for+the+Penn+Treebank+Project%2E+University+of+Pennsylvania%2C+School+of+Engineering+and+Applied+Science%2E)
52. Hollis S. Scarborough. 1990. Index of productive syntax. Applied psycholinguistics, 11(1):1–22. https://doi.org/10.1017/S0142716400008262 [↗](https://doi.org/10.1017/S0142716400008262)
53. Nathan Schneider and Amir Zeldes. 2021. Mischievous nominal constructions in Universal Dependencies. In Proceedings of the Fifth Workshop on Universal Dependencies (UDW, SyntaxFest 2021), pages 160–172, Sofia, Bulgaria. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Nathan+Schneider+and+Amir+Zeldes%2E+2021%2E+Mischievous+nominal+constructions+in+Universal+Dependencies%2E+In+Proceedings+of+the+Fifth+Workshop+on+Universal+Dependencies+%28UDW%2C+SyntaxFest+2021%29%2C+pages+160%E2%80%9317) [our card](https://md.mova.elamur.ai/free/en/docs/papers/schneider-2021-mischievous-nominal-constructions-universal-dependencies/)
54. Natalia Silveira, Timothy Dozat, Marie-Catherine de Marneffe, Samuel Bowman, Miriam Connor, John Bauer, and Christopher D. Manning. 2014. A gold standard dependency corpus for English. In Proceedings of the Ninth International Conference on Language Resources and Evaluation (LREC-2014). [find](https://scholar.google.com/scholar?q=Natalia+Silveira%2C+Timothy+Dozat%2C+Marie%2DCatherine+de+Marneffe%2C+Samuel+Bowman%2C+Miriam+Connor%2C+John+Bauer%2C+and+Christopher+D%2E+Manning%2E+2014%2E+A+gold+standard+dependency+corpus+for+English%2E+In+Proceedings+)
55. Aaron Smith, Bernd Bohnet, Miryam de Lhoneux, Joakim Nivre, Yan Shao, and Sara Stymne. 2018. 82 treebanks, 34 models: Universal Dependency parsing with multi-treebank models. In Proceedings of the CoNLL 2018 Shared Task: Multilingual Parsing from Raw Text to Universal Dependencies, pages 113–123, Brussels, Belgium. Association for Computational Linguistics. https://doi.org/10 .18653/v1/K18-2011 [↗](https://aclanthology.org/K18-2011/) [our card](https://md.mova.elamur.ai/free/en/docs/papers/ud-2018-zeman-conll-2018-shared-task-multilingual/)
56. Ida Szubert, Omri Abend, Nathan Schneider, Samuel Gibbon, Sharon Goldwater, and Mark Steedman. 2021. Cross-linguistically consistent semantic and syntactic annotation of child-directed speech. arXiv preprint arXiv:2109.10952. [↗](https://arxiv.org/abs/2109.10952) [our card](https://md.mova.elamur.ai/free/en/docs/papers/langstream-2021-szubert-cross-linguistically-consistent-semantic-syntactic/)
57. Daniel Varab and Natalie Schluter. 2019. Uni-Parse: A universal graph-based parsing toolkit. In Proceedings of the 22nd Nordic Conference on Computational Linguistics, pages 406–410, Turku, Finland. Linköping University Electronic Press. [find](https://scholar.google.com/scholar?q=Daniel+Varab+and+Natalie+Schluter%2E+2019%2E+Uni%2DParse%3A+A+universal+graph%2Dbased+parsing+toolkit%2E+In+Proceedings+of+the+22nd+Nordic+Conference+on+Computational+Linguistics%2C+pages+406%E2%80%93410%2C+Turku%2C+Finland%2E+L)
58. Richard M. Weist and Andrea A. Zevenbergen. 2008. Autobiographical memory and past time reference. Language Learning and Development, 4(4):291–308. https://doi.org/10.1080/15475440802293490 [↗](https://doi.org/10.1080/15475440802293490)
59. Helen Yannakoudakis, Ted Briscoe, and Ben Medlock. 2011. A new dataset and method for automatically grading ESOL texts. In Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies-Volume 1, pages 180–189. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Helen+Yannakoudakis%2C+Ted+Briscoe%2C+and+Ben+Medlock%2E+2011%2E+A+new+dataset+and+method+for+automatically+grading+ESOL+texts%2E+In+Proceedings+of+the+49th+Annual+Meeting+of+the+Association+for+Computational+L)
60. Masashi Yoshikawa, Hiroyuki Shindo, and Yuji Matsumoto. 2016. Joint transition-based dependency parsing and disfluency detection for automatic speech recognition texts. In Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, pages 1036–1041, Austin, Texas. Association for Computational Linguistics. https:// doi.org/10.18653/v1/D16-1109 Daniel Zeman, Joakim Nivre, Mitchell Abrams, Elia Ackermann, Noëmi Aepli, Hamid Aghaei, Željko Agić, Amir Ahmadi, Lars Ahrenberg, Chika Kennedy Ajede, Gabrielė Aleksandravičiūtė, Ika Alfina, Avner Algom, Erik Andersen, Lene Antonsen, Katya Aplonova, Angelina Aquino, Carolina Aragon, Glyd Aranes, Maria Jesus Aranzabe, Bilge Nas  Arnardóttir, Gashaw Arutie, Arıcan, Hórunn Jessica Naraiswari Arwidarasti, Masayuki Asahara, Deniz Baran Aslan, Cengiz Asmazoğlu, Luma Ateyah, Furkan Atmaca, Mohammed Attia, Aitziber Atutxa, Liesbeth Augustinus, Elena Badmaeva, Keerthana Balasubramani, Miguel Ballesteros, Esha Banerjee, Sebastian Bank, Verginica Barbu Mititelu, Starkaður Barkarson, Rodolfo Basile, Victoria Basmov, Colin Batchelor, John Bauer, Seyyit Talha Bedir, Kepa Bengoetxea, Yifat Ben Moshe, Gözde Berk, Yevgeni Berzak, Irshad Ahmad Bhat, Riyaz Ahmad Bhat, Erica Biagetti, Eckhard Bick, Agnė Bielinskienė, Kristı́n Bjarnadóttir, Rogier Blokland, Victoria Bobicev, Loı̈c Boizou, Emanuel Borges Völker, Carl Börstell, Cristina Bosco, Gosse Bouma, Sam Bowman, Adriane Boyd, Anouck Braggaar, Kristina Brokaitė, Aljoscha Burchardt, Marie Candito, Bernard Caron, Gauthier Caron, Lauren Cassidy, Tatiana Cavalcanti, Gülşen Cebiroğlu Eryiğit, Flavio Massimiliano Cecchini, Giuseppe G. A. Celano, Slavomı́r Čéplö, Neslihan Cesur, Savas Cetin, Özlem Çetinoğlu, Fabricio Chalub, Shweta Chauhan, Ethan Chi, Taishi Chika, Yongseok Cho, Jinho Choi, Jayeol Chun, Juyeon Chung, Alessandra T. Cignarella, Silvie Cinková, Aurélie Collomb, Çağrı Çöltekin, Miriam Connor, Daniela Corbetta, Marine Courtin, Mihaela Cristescu, Philemon Daniel, Elizabeth Davidson, Mathieu Dehouck, Martina de Laurentiis, Marie-Catherine de Marneffe, Valeria de Paiva, Mehmet Oguz Derin, Elvis de Souza, Arantza Diaz de Ilarraza, Carly Dickerson, Arawinda Dinakaramani, Elisa Di Nuovo, Bamba Dione, Peter Dirix, Kaja Dobrovoljc, Timothy Dozat, Kira Droganova, Puneet Dwivedi, Hanne Eckhoff, Sandra Eiche, Marhaba Eli, Ali Elkahky, Binyam Ephrem, Olga Erina, Tomaž Erjavec, Aline Etienne, Wograine Evelyn, Sidney Facundes, Richárd Farkas, Federica Favero, Jannatul Ferdaousi, Marı́lia Fernanda, Hector Fernandez Alcalde, Jennifer Foster, Cláudia Freitas, Kazunori Fujita, Katarı́na Gajdošová, Daniel Galbraith, Federica Gamba, Marcos Garcia, Moa Gärdenfors, Sebastian Garza, Fabrı́cio Ferraz Gerardi, Kim Gerdes, Filip Ginter, Gustavo Godoy, Iakes Goenaga, Koldo Gojenola, Memduh Gökırmak, Yoav Goldberg, Xavier Gómez Guinovart, Berta González Saavedra, Bernadeta Griciūtė, Matias Grioni, Loı̈c Grobol, Normunds Grūzı̄tis, Bruno Guillaume, Céline Guillot-Barbance, Tunga Güngör, Nizar Habash, Hinrik Hafsteinsson, Jan Hajič, Jan Hajič jr., Mika Hämäläinen, Linh Hà Mỹ, Na-Rae Han, Muhammad Yudistira Hanifmuti, Sam Hardwick, Kim Harris, Dag Haug, Johannes Heinecke, Oliver Hellwig, Felix Hennig, Barbora Hladká, Jaroslava Hlaváčová, Florinel Hociung, Petter Hohle, Jena Hwang, Takumi Ikeda, Anton Karl Ingason, Radu Ion, Elena Irimia, Ishola O.lájı́dé, Kaoru Ito, Siratun Jannat, Tomáš Jelı́nek, Apoorva Jha, Anders Johannsen, Hildur Jónsdóttir, Fredrik Jørgensen, Markus Juutinen, Sarveswaran K, Hüner Kaşıkara, Andre Kaasen, Nadezhda Kabaeva, Sylvain Kahane, Hiroshi Kanayama, Jenna Kanerva, Neslihan Kara, Boris Katz, Tolga Kayadelen, Jessica Kenney, Václava Kettnerová, Jesse Kirchner, Elena Klementieva, Elena Klyachko, Arne Köhn, Abdullatif Köksal, Kamil Kopacewicz, Timo Korkiakangas, Mehmet Köse, Natalia Kotsyba, Jolanta Kovalevskaitė, Simon Krek, Parameswari Krishnamurthy, Sandra Kübler, Oğuzhan Kuyrukçu, Aslı Kuzgun, Sookyoung Kwak, Veronika Laippala, Lucia Lam, Lorenzo Lambertino, Tatiana Lando, Septina Dian Larasati, Alexei Lavrentiev, John Lee, Phuong Lê Hô` ng, Alessandro Lenci, Saran Lertpradit, Herman Leung, Maria Levina, Cheuk Ying Li, Josie Li, Keying Li, Yuan Li, KyungTae Lim, Bruna Lima Padovani, Krister Lindén, Nikola Ljubešić, Olga Loginova, Stefano Lusito, Andry Luthfi, Mikko Luukko, Olga Lyashevskaya, Teresa Lynn, Vivien Macketanz, Menel Mahamdi, Jean Maillard, Aibek Makazhanov, Michael Mandl, Christopher Manning, Ruli Manurung, Büşra Marşan, Cătălina Mărănduc, David Mareček, Katrin Marheinecke, Stella Markantonatou, Héctor Martı́nez Alonso, Lorena Martı́n-Rodrı́guez, André Martins, Jan Mašek, Hiroshi Matsuda, Yuji Matsumoto, Alessandro Mazzei, Ryan McDonald, Sarah McGuinness, Gustavo Mendonça, Tatiana Merzhevich, Niko Miekka, Karina Mischenkova, Margarita Misirpashayeva, Anna Missilä, Cătălin Mititelu, Maria Mitrofan, Yusuke Miyao, AmirHossein Mojiri Foroushani, Judit Molnár, Amirsaeid Moloodi, Simonetta Montemagni, Amir More, Laura Moreno Romero, Giovanni Moretti, Keiko Sophie Mori, Shinsuke Mori, Tomohiko Morioka, Shigeki Moro, Bjartur Mortensen, Bohdan Moskalevskyi, Kadri Muischnek, Robert Munro, Yugo Murawaki, Kaili Müürisep, Pinkey Nainwani, Mariam Nakhlé, Juan Ignacio Navarro Horñiacek, Anna Nedoluzhko, Gunta Nešpore-Bērzkalne, Manuela Nevaci, Luong Nguyê˜ n, Huyê` n Nguyê˜ n Thi. Minh, Yoshihiro Nikaido, Vitaly Nikolaev, Rattima Nitisaroj, Alireza Nourian, Hanna Nurmi, Stina Ojala, Atul Kr. Ojha, Adédayo. Olúòkun, Mai Omura, Emeka Onwuegbuzia, Petya Osenova, Robert Östling, Lilja Øvrelid, Şaziye Betül Özateş, Merve Özçelik, Arzucan Özgür, Öztürk Başaran Balkız, Teresa Paccosi, Alessio Palmero Aprosio, Hyunji Hayley Park, Niko Partanen, Elena Pascual, Marco Passarotti, Agnieszka Patejuk, Guilherme Paulino-Passos, Angelika Peljak-Łapińska, Siyao Peng, Cenel-Augusto Perez, Natalia Perkova, Guy Perrier, Slav Petrov, Daria Petrova, Jason Phelan, Jussi Piitulainen, Tommi A. Pirinen, Emily Pitler, Barbara Plank, Thierry Poibeau, Larisa Ponomareva, Martin Popel, Lauma Pretkalniņa, Sophie Prévost, Prokopis Prokopidis, Adam Przepiórkowski, Tiina Puolakainen, Sampo Pyysalo, Peng Qi, Andriela Rääbis, Alexandre Rademaker, Mizanur Rahoman, Taraka Rama, Loganathan Ramasamy, Carlos Ramisch, Fam Rashel, Mohammad Sadegh Rasooli, Vinit Ravishankar, Livy Real, Petru Rebeja, Siva Reddy, Mathilde Regnault, Georg Rehm, Ivan Riabov, Michael Rießler, Erika Rimkutė, Larissa Rinaldi, Laura Rituma, Putri Rizqiyah, Luisa Rocha, Eirı́kur Rögnvaldsson, Mykhailo Romanenko, Rudolf Rosa, Valentin Ros , ca, Davide Rovati, Olga Rudina, Jack Rueter, Kristján Rúnarsson, Shoval Sadde, Pegah Safari, Benoı̂t Sagot, Aleksi Sahala, Shadi Saleh, Alessio Salomoni, Tanja Samardžić, Stephanie Samson, Manuela Sanguinetti, Ezgi Sanıyar, Dage Särg, Baiba Saulı̄te, Yanin Sawanakunanon, Shefali Saxena, Kevin Scannell, Salvatore Scarlata, Nathan Schneider, Sebastian Schuster, Lane Schwartz, Djamé Seddah, Wolfgang Seeker, Mojgan Seraji, Syeda Shahzadi, Mo Shen, Atsuko Shimada, Hiroyuki Shirasu, Yana Shishkina, Muh Shohibussirri, Dmitry Sichinava, Janine Siewert, Einar Freyr Sigurðsson, Aline Silveira, Natalia Silveira, Maria Simi, Radu Simionescu, Katalin Simkó, Mária Šimková, Kiril Simov, Maria Skachedubova, Aaron Smith, Isabela Soares-Bastos, Shafi Sourov,  Carolyn Spadine, Rachele Sprugnoli, Stein hór Steingrı́msson, Antonio Stella, Milan Straka, Emmett Strickland, Jana Strnadová, Alane Suhr, Yogi Lesmana Sulestio, Umut Sulubacak, Shingo Suzuki, Zsolt Szántó, Chihiro Taguchi, Dima Taji, Yuta Takahashi, Fabio Tamburini, Mary Ann C. Tan, Takaaki Tanaka, Dipta Tanaya, Samson Tella, Isabelle Tellier, Marinella Testori, Guillaume Thomas, Liisi Torga, Marsida Toska, Trond Trosterud, Anna Trukhina, Reut Tsarfaty, Utku Türk, Francis Tyers, Sumire Uematsu, Roman Untilov, Zdeňka Urešová, Larraitz Uria, Hans Uszkoreit, Andrius Utka, Sowmya Vajjala, Rob van der Goot, Martine Vanhove, Daniel van Niekerk, Gertjan van Noord, Viktor Varga, Eric Villemonte de la Clergerie, Veronika Vincze, Natalia Vlasova, Aya Wakasa, Joel C. Wallenberg, Lars Wallin, Abigail Walsh, Jing Xian Wang, Jonathan North Washington, Maximilan Wendt, Paul Widmer, Sri Hartati Wijono, Seyi Williams, Mats Wirén, Christian Wittern, Tsegay Woldemariam, Tak-sum Wong, Alina Wróblewska, Mary Yako, Kayo Yamashita, Naoki Yamazaki, Chunxiao Yan, Koichi Yasuoka, Marat M. Yavrumyan, Arife Betül Yenice, Olcay Taner Yıldız, Zhuoran Yu, Arlisa Yuliawati, Zdeněk Žabokrtský, Shorouq Zahra, Amir Zeldes, He Zhou, Hanzhi Zhu, Anna Zhuravleva, and Rayan Ziane. 2022. Universal dependencies 2.10. LINDAT/CLARIAH-CZ digital library at the Institute of Formal and Applied Linguistics (ÚFAL), Faculty of Mathematics and Physics, Charles University. [↗](https://doi.org/10.18653/v1/d16-1109) [our card](https://md.mova.elamur.ai/free/en/docs/papers/aclbulk-2016-yoshikawa-joint-transition-based-dependency-parsing/)