[Mova](https://md.mova.elamur.ai/free/en/) · [this page in HTML](https://mova.elamur.ai/free/en/docs/papers/bank-2008-maamouri-diacritic-annotation-arabic-treebank-its/) [home](https://md.mova.elamur.ai/free/en/) / [docs](https://md.mova.elamur.ai/free/en/docs/) / [papers](https://md.mova.elamur.ai/free/en/docs/papers/) / [Semitic languages](https://md.mova.elamur.ai/free/en/docs/papers/sem/) / Diacritic Annotation in the Arabic Treebank and its Impact on Parser Evaluation # Diacritic Annotation in the Arabic Treebank and its Impact on Parser Evaluation **Authors:** [Mohamed Maamouri](https://md.mova.elamur.ai/free/en/docs/papers/authors/mohamed-maamouri/); [Seth Kulick](https://md.mova.elamur.ai/free/en/docs/papers/authors/seth-kulick/); [Ann Bies](https://md.mova.elamur.ai/free/en/docs/papers/authors/ann-bies/) · **Year:** 2008 · **Venue:** Proceedings of the Sixth International Conference on Language Resources and Evaluation (LREC'08) **Link:** [aclanthology.org/L08-1361](https://aclanthology.org/L08-1361/) · library `bank-2008-maamouri-diacritic-annotation-arabic-treebank-its` · **Licence:** [CC BY-NC-SA 3.0](https://creativecommons.org/licenses/by-nc-sa/3.0/) (ACL Anthology, before 2016) — summary only [**5** citations in our library](https://md.mova.elamur.ai/free/en/docs/papers/cited-by/bank-2008-maamouri-diacritic-annotation-arabic-treebank-its/) of the 140673 papers whose bibliographies we read[Proceedings of the Sixth International Conference on Language Resources and Evaluation (LREC'08)](https://aclanthology.org/volumes/L08-1/)[licence](https://creativecommons.org/licenses/by-nc-sa/3.0/) - [Publisher's page](https://aclanthology.org/L08-1361/) - [PDF](https://aclanthology.org/L08-1361.pdf) **Authors (3)** 1. Mohamed Maamouri 2. Seth Kulick 3. Ann Bies Citations and author metrics from OpenAlex (); authors with the same name are not always told apart. ## What it is about The Arabic Treebank is released in a vocalized and an unvocalized form of each file, and most parsing work used the unvocalized trees as "real-world" input. The authors show that this is not so. The unvocalized trees are the vocalized forms with short vowels stripped, not the source text with clitics split off, and the vocalized forms can carry normalizations that the source does not have. In part 3, section 3, 13,298 of 355,870 tokens (3.7%) differ from the source. One example: a source token with the preposition li and the article Al gets an alif in the treebank that the source lacks. The release therefore adds pointers from split tokens to source tokens, and a tree format whose leaves carry the source token, the unvocalized and vocalized forms, the lemma and the gloss. The paper argues that any parsing experiment must state which of these inputs it uses. ## Ideas - I1. A check in `tools/hbo`: for each gold token, the segments with their unpointed forms must concatenate to the source token. Count the mismatches on the gold set. The 3.7% figure says that a released "unpointed" form can be a hybrid. - I2. Standoff pointers in the `tools/hbo` output: each CoNLL-U token keeps the index of its source token (in the MISC column), so segmentation, pointed and unpointed levels can be compared without realignment. - I3. Report parser scores on source-form input and on pointed-form input as separate rows, never a mixture, both for `tools/hbo` and for trees from `macula`. ## For Mova I1 and I2 belong to `tools/hbo`, with the output format described in [13. Biblical Hebrew in Mova: the tools](https://md.mova.elamur.ai/free/en/docs/languages/hbo/13-mova-tools/). I3 is a rule for every `gparse` report. Topics: [Treebanks](https://md.mova.elamur.ai/free/en/docs/papers/topics/treebanks/) ## Cite The paper itself, not this card. BibTeX from the library's record of the work. ``` @inproceedings{maamouri2008diacritic, title = {{Diacritic Annotation in the Arabic Treebank and its Impact on Parser Evaluation}}, author = {Maamouri, Mohamed and Kulick, Seth and Bies, Ann}, booktitle = {Proceedings of the Sixth International Conference on Language Resources and Evaluation (LREC'08)}, year = {2008}, url = {https://aclanthology.org/L08-1361/} } ``` - [← previous Developing an Arabic Treebank: Methods, Guidelines, Procedures, and Tools](https://md.mova.elamur.ai/free/en/docs/papers/bank-2004-maamouri-developing-arabic-treebank-methods-guidelines/) - [next → Syntactic Annotation Guidelines for the Quranic Arabic Dependency Treebank](https://md.mova.elamur.ai/free/en/docs/papers/bank-2010-dukes-syntactic-annotation-guidelines-quranic-arabic/) - [↑ back to Semitic languages](https://md.mova.elamur.ai/free/en/docs/papers/sem/) ## References 6 references, 2 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet. 1. Daniel M. Bikel. 2004. On the Parameter Space of Lexicalized Statistical Parsing Models. Ph.D. thesis, Department of Computer and Information Sciences, University of Pennsylvania. [find](https://scholar.google.com/scholar?q=Daniel+M%2E+Bikel%2E+2004%2E+On+the+Parameter+Space+of+Lexicalized+Statistical+Parsing+Models%2E+Ph%2ED%2E+thesis%2C+Department+of+Computer+and+Information+Sciences%2C+University+of+Pennsylvania%2E) 2. Tim Buckwalter. 2004. Arabic morphological analyzer version 2.0. LDC2004L02. Linguistic Data Consortium. [find](https://scholar.google.com/scholar?q=Tim+Buckwalter%2E+2004%2E+Arabic+morphological+analyzer+version+2%2E0%2E+LDC2004L02%2E+Linguistic+Data+Consortium%2E) 3. Nizar Habash and Owen Rambow. 2005. Arabic tokenization, part-of-speech tagging and morphological disambiguation in one fell swoop. In Proceedings of the 43rd Annual Meeting of the Association for Computational Linguistics (ACL’05), pages 573–580, Ann Arbor, Michigan, June. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Nizar+Habash+and+Owen+Rambow%2E+2005%2E+Arabic+tokenization%2C+part%2Dof%2Dspeech+tagging+and+morphological+disambiguation+in+one+fell+swoop%2E+In+Proceedings+of+the+43rd+Annual+Meeting+of+the+Association+for+Com) [our card](https://md.mova.elamur.ai/free/en/docs/papers/aclbulk-2005-habash-arabic-tokenization-part-speech-tagging/) 4. Seth Kulick, Ryan Gabbard, and Mitchell Marcus. 2006. Parsing the Arabic Treebank: Analysis and improvements. In Proceedings of TLT 2006. Treebanks and Linguistic Theories. [find](https://scholar.google.com/scholar?q=Seth+Kulick%2C+Ryan+Gabbard%2C+and+Mitchell+Marcus%2E+2006%2E+Parsing+the+Arabic+Treebank%3A+Analysis+and+improvements%2E+In+Proceedings+of+TLT+2006%2E+Treebanks+and+Linguistic+Theories%2E) 5. Mohamed Maamouri and Ann Bies. 2004. Developing an arabic treebank: Methods, guidelines, procedures, and tools. In Ali Farghaly and Karine Megerdoomian, editors, COLING 2004 Computational Approaches to Arabic Script-based Languages, pages 2–9, Geneva, Switzerland, August 28th. COLING. [find](https://scholar.google.com/scholar?q=Mohamed+Maamouri+and+Ann+Bies%2E+2004%2E+Developing+an+arabic+treebank%3A+Methods%2C+guidelines%2C+procedures%2C+and+tools%2E+In+Ali+Farghaly+and+Karine+Megerdoomian%2C+editors%2C+COLING+2004+Computational+Approaches+t) [our card](https://md.mova.elamur.ai/free/en/docs/papers/bank-2004-maamouri-developing-arabic-treebank-methods-guidelines/) 6. Mohamed Maamouri, Ann Bies, and Seth Kulick. 2006. Diacritization: A challenge to Arabic treebank annotation and parsing. In Proceedings of the British Computer Society Arabic NLP/MT Conference, London, UK, October. [find](https://scholar.google.com/scholar?q=Mohamed+Maamouri%2C+Ann+Bies%2C+and+Seth+Kulick%2E+2006%2E+Diacritization%3A+A+challenge+to+Arabic+treebank+annotation+and+parsing%2E+In+Proceedings+of+the+British+Computer+Society+Arabic+NLP%2FMT+Conference%2C+Londo)