[Mova](https://md.mova.elamur.ai/free/en/) · [this page in HTML](https://mova.elamur.ai/free/en/docs/papers/aclbulk-2025-alblooshi-uncertainty-driven-partial-diacritization-arabic/) [home](https://md.mova.elamur.ai/free/en/) / [docs](https://md.mova.elamur.ai/free/en/docs/) / [papers](https://md.mova.elamur.ai/free/en/docs/papers/) / [Semitic languages](https://md.mova.elamur.ai/free/en/docs/papers/sem/) / Uncertainty-driven Partial Diacritization for Arabic Text # Uncertainty-driven Partial Diacritization for Arabic Text **Authors:** Humaid Ali Alblooshi; Artem Shelmanov; [Hanan Aldarmaki](https://md.mova.elamur.ai/free/en/docs/papers/authors/hanan-aldarmaki/) · **Year:** 2025 · **Venue:** Proceedings of the 2nd Workshop on Uncertainty-Aware NLP (UncertaiNLP 2025), pp. 1–10 **Link:** [aclanthology.org/2025.uncertainlp-main.1](https://aclanthology.org/2025.uncertainlp-main.1/) · library `aclbulk-2025-alblooshi-uncertainty-driven-partial-diacritization-arabic` · **Licence:** [CC BY 4.0](https://creativecommons.org/licenses/by/4.0/) (ACL Anthology) [**1** citations](https://openalex.org/works?filter=cites:W4416033703) openalex · 2026-10-18[Proceedings of the 2nd Workshop on Uncertainty-Aware NLP (UncertaiNLP 2025)](https://aclanthology.org/volumes/2025.uncertainlp-main/)[licence](https://creativecommons.org/licenses/by/4.0/) - [Publisher's page](https://aclanthology.org/2025.uncertainlp-main.1/) - [PDF](https://aclanthology.org/2025.uncertainlp-main.1.pdf) - [DOI 10.18653/v1/2025.uncertainlp-main.1](https://doi.org/10.18653/v1/2025.uncertainlp-main.1) - [OpenAlex](https://openalex.org/W4416033703) **Authors (3)** 1. [Humaid Ali Alblooshi](https://openalex.org/A5119938296) h 1 · 3 citations · 5 works 2. [Artem Shelmanov](https://openalex.org/A5071397402) [ORCID](https://orcid.org/0000-0002-2151-6212) · [Semantic Scholar](https://www.semanticscholar.org/author/2446721141) · h 16 · 852 citations · 92 works 3. [Hanan Aldarmaki](https://openalex.org/A5002602581) [ORCID](https://orcid.org/0000-0003-1706-1777) · [Semantic Scholar](https://www.semanticscholar.org/author/2315308263) · h 8 · 267 citations · 75 works Citations and author metrics from openalex (2026-10-18); authors with the same name are not always told apart. ## What it is about Full diacritization makes Arabic text dense, so the paper asks which diacritics to keep and which to drop. It uses a character-based encoder-decoder diacritic restorer (CATT) and scores each character with one of three uncertainty measures: softmax response, BALD (Monte Carlo dropout) and Mahalanobis distance. A character is kept or dropped by thresholding its score. On the Tashkeela test set, softmax response tracks the diacritic error rate best and is cheap to compute; keeping 80% of the diacritics gives a diacritic error rate of about 2.5%. On the out-of-domain ArVoice test set the base error rate is above 10%, and a Confident Error Regularizer trades recall for precision in finding error-prone words, at a cost in overall error. The authors call the work exploratory: there is no standard evaluation for partial diacritization yet. ## Ideas - I1. Use the softmax-response score of a diacritic model as a per-character keep/drop rule. A Hebrew analogue is the point set of unpointed-to-pointed text in `tools/hbo`: keep the vowel points the model is unsure of and drop the ones it predicts with confidence, and report a diacritic-error-versus-coverage curve. - I2. Use the same confidence signal as a fallback switch: when the pointed model is unsure about a word, use the unpointed mode of `tools/hbo` for that word instead of guessing. The paper's numbers are the reference for how much this should cost in error. - I3. Use the diacritic-error-versus-coverage curve as a measure: sweep the threshold and plot the error against the share of marks kept. This is a cheap, model-independent test to run on any pointing rule set, including the vowel rules in [1. Script and pointing](https://md.mova.elamur.ai/free/en/docs/languages/hbo/01-script/). ## For Mova I1 and I2 apply to `tools/hbo` (the pointed and unpointed modes) and to the choice of which marks a reader needs, [1. Script and pointing](https://md.mova.elamur.ai/free/en/docs/languages/hbo/01-script/) and [2. Cantillation: the accents (te'amim)](https://md.mova.elamur.ai/free/en/docs/languages/hbo/02-cantillation/). I3 is a measurement for the same tool. The paper's Confident Error Regularizer is a neural training method, so it does not transfer directly to Mova's rule and table components. ## Cite The paper itself, not this card. BibTeX from the library's record of the work. [DOI 10.18653/v1/2025.uncertainlp-main.1](https://doi.org/10.18653/v1/2025.uncertainlp-main.1) ``` @inproceedings{alblooshi2025uncertainty, title = {{Uncertainty-driven Partial Diacritization for Arabic Text}}, author = {Alblooshi, Humaid Ali and Shelmanov, Artem and Aldarmaki, Hanan}, booktitle = {Proceedings of the 2nd Workshop on Uncertainty-Aware NLP (UncertaiNLP 2025)}, year = {2025}, doi = {10.18653/v1/2025.uncertainlp-main.1}, url = {https://doi.org/10.18653/v1/2025.uncertainlp-main.1} } ``` - [← previous Out-of-Domain Dependency Parsing for Dialects of Arabic: A Case Study](https://md.mova.elamur.ai/free/en/docs/papers/aclbulk-2024-mokh-out-domain-dependency-parsing-dialects/) - [next → EvaCun 2025 Shared Task: Lemmatization and Token Prediction in Akkadian and Sumerian using LLMs](https://md.mova.elamur.ai/free/en/docs/papers/aclbulk-2025-gordin-evacun-2025-shared-task-lemmatization/) - [↑ back to Semitic languages](https://md.mova.elamur.ai/free/en/docs/papers/sem/) ## References 1 references, 0 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet. 1. Sawsan Alqahtani, Hanan Aldarmaki, and Mona Diab. 2019. Homograph disambiguation through selective diacritic restoration. In Proceedings of the Fourth Arabic Natural Language Processing Workshop, pages 49–59, Florence, Italy. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Sawsan+Alqahtani%2C+Hanan+Aldarmaki%2C+and+Mona+Diab%2E+2019%2E+Homograph+disambiguation+through+selective+diacritic+restoration%2E+In+Proceedings+of+the+Fourth+Arabic+Natural+Language+Processing+Workshop%2C+page)