[Mova](https://md.mova.elamur.ai/free/en/) · [this page in HTML](https://mova.elamur.ai/free/en/docs/papers/aclbulk-2004-buckwalter-issues-arabic-orthography-morphology-analysis/) [home](https://md.mova.elamur.ai/free/en/) / [docs](https://md.mova.elamur.ai/free/en/docs/) / [papers](https://md.mova.elamur.ai/free/en/docs/papers/) / [Semitic languages](https://md.mova.elamur.ai/free/en/docs/papers/sem/) / Issues in Arabic Orthography and Morphology Analysis # Issues in Arabic Orthography and Morphology Analysis **Authors:** Tim Buckwalter · **Year:** 2004 · **Venue:** Proceedings of the Workshop on Computational Approaches to Arabic Script-based Languages **Link:** [aclanthology.org/W04-1606](https://aclanthology.org/W04-1606/) · library `aclbulk-2004-buckwalter-issues-arabic-orthography-morphology-analysis` · **Licence:** [CC BY-NC-SA 3.0](https://creativecommons.org/licenses/by-nc-sa/3.0/) (ACL Anthology, before 2016) — summary only [**82** citations](https://openalex.org/works?filter=cites:W2042777049) openalex · 2026-10-19[**16** citations in our library](https://md.mova.elamur.ai/free/en/docs/papers/cited-by/aclbulk-2004-buckwalter-issues-arabic-orthography-morphology-analysis/) of the 140673 papers whose bibliographies we read[Proceedings of the Workshop on Computational Approaches to Arabic Script-based Languages](https://aclanthology.org/volumes/W04-16/)[licence](https://creativecommons.org/licenses/by-nc-sa/3.0/) - [Publisher's page](https://aclanthology.org/W04-1606/) - [PDF](https://aclanthology.org/W04-1606.pdf) - [DOI 10.3115/1621804.1621813](https://doi.org/10.3115/1621804.1621813) - [OpenAlex](https://openalex.org/W2042777049) **Authors (1)** 1. [Buckwalter, Tim](https://openalex.org/A5062893665) [Semantic Scholar](https://www.semanticscholar.org/author/3300960) · h 9 · 754 citations · 14 works Citations and author metrics from openalex (2026-10-19); authors with the same name are not always told apart. ## What it is about A case report from the LDC, where the Buckwalter Arabic Morphological Analyzer was used on about 542,000 word tokens of three Arabic newswire corpora (2002–2004). The author lists the orthographic anomalies that the annotators met. In one agency's text, hamza is dropped on alif in stem-medial and stem-final positions. In another, word-final alif maqsura is spelled with two dots. Some "run-on" words join a preceding function word to the next word with no space, such as la- or ma- plus a verb. The analyzer was changed for some cases (both ya and alif maqsura are now tried) and kept strict for others (the "qala 'anna" construction is accepted as grammatical). The paper is not a measurement study. Its argument is that each normalisation carries assumptions that the output should record, and that run-on words make the definition of a "word token" itself doubtful. ## Ideas - I1. Record the normalisation in every analysis: each analysis carries a flag for the method used (exact match, or a rewrite such as alif maqsura for ya, or a hamza change), as the paper argues. In `tools/hbo` (unpointed mode) a segmentation should say whether it was read as written or after a rewrite, so that later scores can tell the two apart. - I2. A test set of run-on forms: collect cases where a clitic or a short function word has lost its space before the next word (the paper's la + verb, ma + verb), and check that the segmenter proposes both one-token and two-token readings. This is a measure for `tools/hbo`, and any Semitic segmenter Mova adds later. - I3. Keep "possible tokens" separate from "word tokens": an input string may be one token or several, and each reading should be scored on its own. This matches the way `tools/hbo` already runs segmentation before parsing. ## For Mova I1 and I3 go into the design of `tools/hbo` (the segmenter stage, unpointed mode), and the orthographic variation discussed in the paper matches what [1. Script and pointing](https://md.mova.elamur.ai/free/en/docs/languages/hbo/01-script/) and [2. Script and spelling](https://md.mova.elamur.ai/free/en/docs/languages/he/02-script-and-spelling/) have to describe. I2 is a test set for `tools/hbo`. Arabic is not a Mova language yet, so nothing here goes into a grammar file. ## Cite The paper itself, not this card. BibTeX from the library's record of the work. [DOI 10.3115/1621804.1621813](https://doi.org/10.3115/1621804.1621813) ``` @inproceedings{buckwalter2004issues, title = {{Issues in Arabic Orthography and Morphology Analysis}}, author = {Buckwalter, Tim}, booktitle = {Proceedings of the Workshop on Computational Approaches to Arabic Script-based Languages}, year = {2004}, doi = {10.3115/1621804.1621813}, url = {https://doi.org/10.3115/1621804.1621813} } ``` - [← previous Parsing Akkadian Verbs with Prolog](https://md.mova.elamur.ai/free/en/docs/papers/aclbulk-2002-macks-parsing-akkadian-verbs-prolog/) - [next → Identifying Broken Plurals in Unvowelised Arabic Text](https://md.mova.elamur.ai/free/en/docs/papers/aclbulk-2004-goweder-identifying-broken-plurals-unvowelised-arabic/) - [↑ back to Semitic languages](https://md.mova.elamur.ai/free/en/docs/papers/sem/) ## References 3 references, 0 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet. 1. Elsaid Badawi, M.G. Carter, and Adrian Wallace. 2004. Modern Written Arabic: A Comprehensive Grammar. Routledge, London. [find](https://scholar.google.com/scholar?q=Elsaid+Badawi%2C+M%2EG%2E+Carter%2C+and+Adrian+Wallace%2E+2004%2E+Modern+Written+Arabic%3A+A+Comprehensive+Grammar%2E+Routledge%2C+London%2E) 2. Tim Buckwalter. 1992. “Orthographic Variation in Arabic and its Relevance to Automatic Spell-Checking,” in Proceedings of the Third International Conference on Multilingual Computing (Arabic and Roman Script), University of Durham, U.K., December 10-12, 1992. [find](https://scholar.google.com/scholar?q=Tim+Buckwalter%2E+1992%2E+%E2%80%9COrthographic+Variation+in+Arabic+and+its+Relevance+to+Automatic+Spell%2DChecking%2C%E2%80%9D+in+Proceedings+of+the+Third+International+Conference+on+Multilingual+Computing+%28Arabic+and+Roman) 3. Tim Buckwalter. 2002. Buckwalter Arabic Morphological Analyzer Version 1.0. Linguistic Data Consortium, catalog number LDC2002L49 and ISBN 1-58563-257-0. < [http://www.ldc.upenn.edu/Catalog/CatalogEntry.jsp?catalogId=](http://www.ldc.upenn.edu/Catalog/CatalogEntry.jsp?catalogId=) LDC2002L49 > Mohamed Maamouri, et al. 2003. Arabic Treebank: Part 1 v 2.0. Linguistic Data Consortium, catalog number LDC2003T06 and ISBN: 1-58563-261-9. < http://www.ldc.upenn.-edu/Catalog/CatalogEntry.jsp?catalogId=LDC2003T06 > Mohamed Maamouri, et al. 2004. Arabic Treebank: Part 2 v 2.0. Linguistic Data Consortium, catalog number LDC2004T02 and ISBN: 1-58563-282-1. < http://www.ldc.upenn.-edu/Catalog/CatalogEntry.jsp?catalogId=LDC2004T02 > Mohamed Maamouri, et al. 2004. Arabic Treebank: Part 3 v 1.0. Linguistic Data Consortium, catalog number LDC2004T11 and ISBN: 1-58563-298-8. < http://www.ldc.upenn.-edu/Catalog/CatalogEntry.jsp?catalogId=LDC2004T11 > [↗](http://www.ldc.upenn.edu/Catalog/CatalogEntry.jsp?catalogId=)