[Mova](https://md.mova.elamur.ai/free/en/) · [this page in HTML](https://mova.elamur.ai/free/en/docs/papers/hbo-2024-cohen-menakbert-hebrew-diacriticizer/) [home](https://md.mova.elamur.ai/free/en/) / [docs](https://md.mova.elamur.ai/free/en/docs/) / [papers](https://md.mova.elamur.ai/free/en/docs/papers/) / [Ancient Hebrew](https://md.mova.elamur.ai/free/en/docs/papers/hbo/) / MenakBERT — Hebrew Diacriticizer # MenakBERT — Hebrew Diacriticizer **Authors:** Ido Cohen, Jacob Gidron, Idan Pinto · **Year:** 2024 · **Venue:** arXiv 2410.02417 (Tel Aviv University student paper) **Link:** [arxiv.org/abs/2410.02417](https://arxiv.org/abs/2410.02417) · **Licence:** copyrighted — summary only (arXiv non-exclusive licence) [**0** citations](https://openalex.org/works?filter=cites:W4403883901) openalex · 2026-10-18[**2** citations in our library](https://md.mova.elamur.ai/free/en/docs/papers/cited-by/hbo-2024-cohen-menakbert-hebrew-diacriticizer/) of the 140673 papers whose bibliographies we read[arXiv:2410.02417](https://openalex.org/S4306400194)[licence](http://arxiv.org/licenses/nonexclusive-distrib/1.0/) - [Publisher's page](https://arxiv.org/abs/2410.02417) - [PDF](https://arxiv.org/pdf/2410.02417) - [arXiv 2410.02417](https://arxiv.org/abs/2410.02417) - [OpenAlex](https://openalex.org/W4403883901) **Authors (3)** 1. [Ido Cohen](https://openalex.org/A5102000230) [ORCID](https://orcid.org/0009-0008-9187-0840) · [Semantic Scholar](https://www.semanticscholar.org/author/2113905042) · h 3 · 59 citations · 9 works 2. [Jacob Gidron](https://openalex.org/A5009457488) [Semantic Scholar](https://www.semanticscholar.org/author/2187208232) · h 2 · 50 citations · 4 works 3. [Idan Pinto](https://openalex.org/A5033091620) [ORCID](https://orcid.org/0000-0003-4109-9564) · [Semantic Scholar](https://www.semanticscholar.org/author/2213145525) · h 0 · 0 citations · 8 works Citations and author metrics from openalex (2026-10-18); authors with the same name are not always told apart. ## What it is about The task is to add niqqud to plain Hebrew. Following Nakdimon, the marks are split into three decisions per letter: the shin/sin dot, the dagesh, and the vowel. The authors fine-tune TavBERT, a character-level BERT pretrained on 3.1 billion Hebrew words, with three output heads, on Nakdimon's data (2.6 million premodern and 0.3 million modern characters), trained in chronological order so the model ends on modern text. On Nakdimon's test set it scores 98.82% decision accuracy and 94.12% word accuracy, close to Dicta's rule-assisted Nakdan (98.94 / 95.83) and above Nakdimon. Errors include verb/adjective homographs, the definite article hidden in the vowel of a prefixed preposition (וּבָרְכוּשׁ vs וּבִרְכוּשׁ), and foreign names; a model fine-tuned for dotting also transfers to POS tagging. ## Ideas - I1. The three-way split of the pointing (shin/sin dot, dagesh, vowel) is a clean way to describe what the marks do: use it in the script chapter, and in any Mova check of pointed text count errors per category. - I2. The hidden article: after בְּ/כְּ/לְ the article shows only in the prefix's vowel and the following dagesh. Check on the Torah trees that every such case gets `Definite=Def`, and state the rule (pataḥ/qameṣ + dagesh after the prefix = article) in the noun chapter. - I3. The four scores DEC/CHA/WOR/VOC (decision, character, word, and "pronounced right") are the standard for a vocaliser; reuse them if Mova ever vocalises Mishnaic or unpointed text. ## For Mova Mova's Torah is already pointed, so the model itself is not needed. I1 goes to [1. Script and pointing](https://md.mova.elamur.ai/free/en/docs/languages/hbo/01-script/); I2 is a check in `tools/macula` (FEATS) and a point in `04-noun.md` (the article); I3 is the scoring for any future vocaliser, described in `13-mova-tools.md`. ## Cite The paper itself, not this card. BibTeX from the library's record of the work. [arXiv 2410.02417](https://arxiv.org/abs/2410.02417) ``` @misc{cohen2024menakbert, title = {{MenakBERT — Hebrew Diacriticizer}}, author = {Cohen, Ido and Gidron, Jacob and Pinto, Idan}, year = {2024}, eprint = {2410.02417}, archivePrefix = {arXiv}, url = {https://arxiv.org/abs/2410.02417} } ``` - [← previous Toward a Period-Specific Optimized Neural Network for OCR Error Correction of Historical Hebrew Texts](https://md.mova.elamur.ai/free/en/docs/papers/hbo-2023-suissa-toward-period-specific-optimized-neural/) - [next → The End of Desire: On the Meaning of תשוקה in the Hebrew Scriptures and the Dead Sea Scrolls](https://md.mova.elamur.ai/free/en/docs/papers/hbo-2024-condren-end-desire-meaning-hebrew-scriptures/) - [↑ back to Ancient Hebrew](https://md.mova.elamur.ai/free/en/docs/papers/hbo/) ## References 8 references, 4 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet. 1. Ya’akov Gal. 2002. An HMM approach to vowel restoration in Arabic and Hebrew. In Proceedings of the ACL-02 Workshop on Computational Approaches to Semitic Languages, Philadelphia, Pennsylvania, USA. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Ya%E2%80%99akov+Gal%2E+2002%2E+An+HMM+approach+to+vowel+restoration+in+Arabic+and+Hebrew%2E+In+Proceedings+of+the+ACL%2D02+Workshop+on+Computational+Approaches+to+Semitic+Languages%2C+Philadelphia%2C+Pennsylvania%2C+USA%2E+A) [our card](https://md.mova.elamur.ai/free/en/docs/papers/aclbulk-2002-gal-hmm-approach-vowel-restoration-arabic/) 2. Leonid Kontorovich. 2001. Problems in semitic nlp: Hebrew vocalization using hmms. [find](https://scholar.google.com/scholar?q=Leonid+Kontorovich%2E+2001%2E+Problems+in+semitic+nlp%3A+Hebrew+vocalization+using+hmms%2E) 3. Avi Shmidman, Shaltiel Shmidman, Moshe Koppel, and Yoav Goldberg. 2020. Nakdan: Professional Hebrew diacritizer. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics: System Demonstrations, pages 197– 203, Online. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Avi+Shmidman%2C+Shaltiel+Shmidman%2C+Moshe+Koppel%2C+and+Yoav+Goldberg%2E+2020%2E+Nakdan%3A+Professional+Hebrew+diacritizer%2E+In+Proceedings+of+the+58th+Annual+Meeting+of+the+Association+for+Computational+Linguist) [our card](https://md.mova.elamur.ai/free/en/docs/papers/aclbulk-2020-shmidman-nakdan-professional-hebrew-diacritizer/) 4. Elazar Gershuni, Yuval Pinter. 2021. Restoring Hebrew Diacritics Without a Dictionary (Nakdimon). [find](https://scholar.google.com/scholar?q=Elazar+Gershuni%2C+Yuval+Pinter%2E+2021%2E+Restoring+Hebrew+Diacritics+Without+a+Dictionary+%28Nakdimon%29%2E) [our card](https://md.mova.elamur.ai/free/en/docs/papers/findings-2022-gershuni-restoring-hebrew-diacritics-without-dictionary/) 5. Omri Keren, Tal Avinari, Reut Tsarfaty, Omer Levy. 2022. Breaking Character: Are Subwords Good Enough for MRLs After All? [find](https://scholar.google.com/scholar?q=Omri+Keren%2C+Tal+Avinari%2C+Reut+Tsarfaty%2C+Omer+Levy%2E+2022%2E+Breaking+Character%3A+Are+Subwords+Good+Enough+for+MRLs+After+All%3F) 6. Jacob Devlin, Ming-Wei Chang, Kenton Lee, Kristina Toutanova. 2018. BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. Mandar Joshi, Danqi Chen, Yinhan Liu, Daniel S. [find](https://scholar.google.com/scholar?q=Jacob+Devlin%2C+Ming%2DWei+Chang%2C+Kenton+Lee%2C+Kristina+Toutanova%2E+2018%2E+BERT%3A+Pre%2Dtraining+of+Deep+Bidirectional+Transformers+for+Language+Understanding%2E+Mandar+Joshi%2C+Danqi+Chen%2C+Yinhan+Liu%2C+Daniel+S%2E) 7. Weld, Luke Zettlemoyer, Omer Levy. 2020. SpanBERT: Improving Pre-training by Representing and Predicting Spans. [find](https://scholar.google.com/scholar?q=Weld%2C+Luke+Zettlemoyer%2C+Omer+Levy%2E+2020%2E+SpanBERT%3A+Improving+Pre%2Dtraining+by+Representing+and+Predicting+Spans%2E) 8. Shoval Sade, Amit Seker, and Reut Tsarfaty. 2018. The Hebrew Universal Dependency treebank: Past present and future Amit Seker and Reut Tsarfaty. 2020. A pointer network architecture for joint morphological segmentation and tagging [find](https://scholar.google.com/scholar?q=Shoval+Sade%2C+Amit+Seker%2C+and+Reut+Tsarfaty%2E+2018%2E+The+Hebrew+Universal+Dependency+treebank%3A+Past+present+and+future+Amit+Seker+and+Reut+Tsarfaty%2E+2020%2E+A+pointer+network+architecture+for+joint+morphol) [our card](https://md.mova.elamur.ai/free/en/docs/papers/ud-2020-seker-pointer-network-architecture-joint-morphological/)