[Mova](https://md.mova.elamur.ai/free/en/) · [this page in HTML](https://mova.elamur.ai/free/en/docs/papers/aclbulk-2021-wenger-automated-extraction-sentencing-decisions-court/) [home](https://md.mova.elamur.ai/free/en/) / [docs](https://md.mova.elamur.ai/free/en/docs/) / [papers](https://md.mova.elamur.ai/free/en/docs/papers/) / [Modern Hebrew](https://md.mova.elamur.ai/free/en/docs/papers/he/) / Automated Extraction of Sentencing Decisions from Court Cases in the Hebrew Language # Automated Extraction of Sentencing Decisions from Court Cases in the Hebrew Language **Authors:** Mohr Wenger, Tom Kalir, Noga Berger, Carmit Klar Chalamish, Renana Keydar, [Gabriel Stanovsky](https://md.mova.elamur.ai/free/en/docs/papers/authors/gabriel-stanovsky/) · **Year:** 2021 · **Venue:** Proceedings of the Natural Legal Language Processing Workshop 2021 **Link:** [aclanthology.org/2021.nllp-1.4](https://aclanthology.org/2021.nllp-1.4/) · library `aclbulk-2021-wenger-automated-extraction-sentencing-decisions-court` · **Licence:** [CC BY 4.0](https://creativecommons.org/licenses/by/4.0/) [**1** citations](https://openalex.org/works?filter=cites:W3208978698) openalex · 2026-10-18[**2** citations in our library](https://md.mova.elamur.ai/free/en/docs/papers/cited-by/aclbulk-2021-wenger-automated-extraction-sentencing-decisions-court/) of the 140673 papers whose bibliographies we read[Proceedings of the Natural Legal Language Processing Workshop 2021](https://aclanthology.org/volumes/2021.nllp-1/)[licence](https://creativecommons.org/licenses/by/4.0/) - [Publisher's page](https://aclanthology.org/2021.nllp-1.4/) - [PDF](https://aclanthology.org/2021.nllp-1.4.pdf) - [DOI 10.18653/v1/2021.nllp-1.4](https://doi.org/10.18653/v1/2021.nllp-1.4) - [OpenAlex](https://openalex.org/W3208978698) **Authors (6)** 1. [Mohr Wenger](https://openalex.org/A5046736484) h 3 · 18 citations · 5 works 2. [Tom Kalir](https://openalex.org/A5030954091) h 1 · 1 citations · 1 works 3. [Noga Berger](https://openalex.org/A5018998307) h 1 · 1 citations · 1 works 4. [Carmit Klar Chalamish](https://openalex.org/A5036070006) h 4 · 75 citations · 9 works 5. [Renana Keydar](https://openalex.org/A5058266588) [ORCID](https://orcid.org/0000-0001-5229-8556) · h 2 · 27 citations · 48 works 6. [Gabriel Stanovsky](https://openalex.org/A5082136238) [ORCID](https://orcid.org/0000-0002-2420-8979) · h 22 · 2605 citations · 140 works Citations and author metrics from openalex (2026-10-18); authors with the same name are not always told apart. ## What it is about The paper defines Automated Punishment Extraction (APE): from an Israeli court sentencing decision in a sexual-offence case, find the sentence that states the actual imprisonment and give its length in months. The corpus has 1043 Magistrate and District Court decisions (1990–2021, from the Nevo database), about 3 million words; 100 cases (13k sentences) are annotated with help from legal experts. Hebrew uses the same word for total imprisonment, actual imprisonment and suspended (probation) imprisonment, which makes the task hard. The system first picks the sentence (keyword filter, then a rule scorer, an SVM or a random forest), then reads the number. The rule-based scorer wins the full task (APE F1 0.65 against 0.58 for random forest and 0.50 for SVM). The best model extracts the correct term in 68% of cases, with an average error of about 5 months. The most common error is taking the probation term for the actual one. The corpus is available only on request. ## Ideas - I1. A deterministic check for compound sentences: when a sentence has exactly three numbers and the total equals the actual term plus the suspended term, take the actual term. This is arithmetic over numerals the parser already tags, so it needs no model. - I2. Weighted cue lists with an explanation: strong and moderate cues for the judicial verb (present tense, infinitive used with past meaning), negative cues for docket brackets and for requests. Score each sentence, pick a threshold on a dev set, and print which cues fired. This fits Mova's "say why" rule. - I3. The Hebrew phrase meaning "and the rest" as a test: it marks the actual term when it follows the number. Write 20–30 sentences with and without the phrase as a test set in the register of legal Hebrew. ## For Mova I1 belongs in [Nouns, adjectives, pronouns and numerals](https://md.mova.elamur.ai/free/en/docs/languages/he/04-nouns-adjectives-pronouns/), in a new numerals section (Mova has no numerals chapter yet). I2 is a rule table in `prag`. I3 goes into [8. Lexicon and register](https://md.mova.elamur.ai/free/en/docs/languages/he/08-lexicon-register/) as a legal-register test. ## Cite The paper itself, not this card. BibTeX from the library's record of the work. [DOI 10.18653/v1/2021.nllp-1.4](https://doi.org/10.18653/v1/2021.nllp-1.4) ``` @inproceedings{wenger2021automated, title = {{Automated Extraction of Sentencing Decisions from Court Cases in the Hebrew Language}}, author = {Wenger, Mohr and Kalir, Tom and Berger, Noga and Chalamish, Carmit Klar and Keydar, Renana and Stanovsky, Gabriel}, booktitle = {Proceedings of the Natural Legal Language Processing Workshop 2021}, year = {2021}, doi = {10.18653/v1/2021.nllp-1.4}, url = {https://doi.org/10.18653/v1/2021.nllp-1.4} } ``` - [← previous Hebrew Psychological Lexicons](https://md.mova.elamur.ai/free/en/docs/papers/aclbulk-2021-shapira-hebrew-psychological-lexicons/) - [next → Detection of Negative Campaign in Israeli Municipal Elections](https://md.mova.elamur.ai/free/en/docs/papers/aclbulk-2022-litvak-detection-negative-campaign-israeli-municipal/) - [↑ back to Modern Hebrew](https://md.mova.elamur.ai/free/en/docs/papers/he/) ## References 2 references, 0 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet. 1. Nikolaos Aletras, Dimitrios Tsarapatsanis, Daniel PreoţiucPietro, and Vasileios Lampos. 2016. Pre dicting judicial decisions of the european court of human rights: A natural language processing per spective. PeerJ Computer Science, 2:e93. *Figure 3: The distribution of predicted punishments in our corpus. These were extracted using our rule-based model which performed best on this task. Median predicted punishment is 3 years, while more than a third of the punishments are below 15 months.* L Karl Branting, Craig Pfeifer, Bradford Brown, Lisa Ferro, John Aberdeen, Brandy Weiss, Mark Pfaff, and Bill Liao. 2021. Scalable and explainable legal prediction. Artificial Intelligence and Law, 29(2):213238. [find](https://scholar.google.com/scholar?q=Nikolaos+Aletras%2C+Dimitrios+Tsarapatsanis%2C+Daniel+Preo%C5%A3iucPietro%2C+and+Vasileios+Lampos%2E+2016%2E+Pre+dicting+judicial+decisions+of+the+european+court+of+human+rights%3A+A+natural+language+processing+per+sp) 2. Ilias Chalkidis, Manos Fergadiotis, Prodromos Malakasiotis, Nikolaos Aletras, and Ion An droutsopoulos. 2020. Legalbert: The mup pets straight out of law school. arXiv preprint arXiv:2010.02559. [↗](https://arxiv.org/abs/2010.02559)