[Mova](https://md.mova.elamur.ai/free/en/) · [this page in HTML](https://mova.elamur.ai/free/en/docs/papers/lingbulk-2024-mondshine-hesum-novel-dataset-abstractive-text/) [home](https://md.mova.elamur.ai/free/en/) / [docs](https://md.mova.elamur.ai/free/en/docs/) / [papers](https://md.mova.elamur.ai/free/en/docs/papers/) / [Modern Hebrew](https://md.mova.elamur.ai/free/en/docs/papers/he/) / HeSum: a Novel Dataset for Abstractive Text Summarization in Hebrew # HeSum: a Novel Dataset for Abstractive Text Summarization in Hebrew **Authors:** [Itai Mondshine](https://md.mova.elamur.ai/free/en/docs/papers/authors/itai-mondshine/); [Tzuf Paz-Argaman](https://md.mova.elamur.ai/free/en/docs/papers/authors/tzuf-paz-argaman/); [Asaf Achi Mordechai](https://md.mova.elamur.ai/free/en/docs/papers/authors/asaf-achi-mordechai/); [Reut Tsarfaty](https://md.mova.elamur.ai/free/en/docs/papers/authors/reut-tsarfaty/) · **Year:** 2024 · **Venue:** Proceedings of LoResMT 2024 (Seventh Workshop on Technologies for Machine Translation of Low-Resource Languages), pp. 26–36 **Link:** [aclanthology.org/2024.loresmt-1.2](https://aclanthology.org/2024.loresmt-1.2/) · library `lingbulk-2024-mondshine-hesum-novel-dataset-abstractive-text` · **Licence:** [CC BY 4.0](https://creativecommons.org/licenses/by/4.0/) (ACL Anthology) [**0** citations](https://openalex.org/works?filter=cites:W4402683138) openalex · 2026-10-18[Proceedings of the Seventh Workshop on Technologies for Machine Translation of Low-Resource Languages (LoResMT 2024)](https://aclanthology.org/volumes/2024.loresmt-1/)[licence](https://creativecommons.org/licenses/by/4.0/) - [Publisher's page](https://aclanthology.org/2024.loresmt-1.2/) - [PDF](https://aclanthology.org/2024.loresmt-1.2.pdf) - [DOI 10.18653/v1/2024.loresmt-1.2](https://doi.org/10.18653/v1/2024.loresmt-1.2) - [OpenAlex](https://openalex.org/W4402683138) **Authors (4)** 1. [Itai Mondshine](https://openalex.org/A5092400975) h 2 · 10 citations · 15 works 2. Tzuf Paz-Argaman 3. [Asaf Achi Mordechai](https://openalex.org/A5099057179) h 1 · 3 citations · 5 works 4. [Reut Tsarfaty](https://openalex.org/A5063283689) [ORCID](https://orcid.org/0000-0001-6406-6568) · h 24 · 2886 citations · 217 works Citations and author metrics from openalex (2026-10-18); authors with the same name are not always told apart. ## What it is about The paper builds HeSum, 10,000 Modern Hebrew news articles paired with the editor-written extended subheadings that serve as summaries, taken from three independent news sites and split 8,000 / 1,000 / 1,000. The authors measure how abstractive these summaries are (share of novel n-grams, compression, redundancy) and compare them with CNN/Daily Mail and XSum. Hebrew adds difficulty: the paper reports a high word ambiguity per article (many alternative segmentations) and frequent morphological anaphors and construct-state nouns. Zero-shot GPT-4 and GPT-3.5 are compared with a fine-tuned mLongT5: mLongT5 gets the highest ROUGE, while GPT-4 gets the best BERTScore (77.3 against 57.6 for mLongT5) and the best human coherence and completeness scores on a 1–5 scale. Error analysis (30 summaries per model) finds repetition, copying, wrong disambiguation, gender errors and hallucinated names. ## Ideas - I1. Report the Hebrew segmentation ambiguity the way the paper does: for each article, count the lattice paths that the segmenter produces, and report the average per split. Run the same count on Hebrew news text, so the difficulty of `he` input is a number, not a feeling. - I2. Turn the error classes of the paper's Table 4 (construct state after a definite article, feminine inflection on a masculine referent, missing diacritics that change a word's reading) into deterministic checks over the `he` morphology: agreement of gender and number between a noun and its predicate, and the definite marking before a construct state. - I3. A held-out check for a future Hebrew summary built from the parse: the share of summary content lemmas that occur in the article's frames (the world of the text). It needs no generation; it is a coverage measure, and the paper's own split is kept held out. ## For Mova I1 goes into [2. Script and spelling](https://md.mova.elamur.ai/free/en/docs/languages/he/02-script-and-spelling/) (the ambiguity note) and is a measure for [12. Mova and Modern Hebrew: where it stands, what it would need](https://md.mova.elamur.ai/free/en/docs/languages/he/12-mova/). I2 goes into [Nouns, adjectives, pronouns and numerals](https://md.mova.elamur.ai/free/en/docs/languages/he/04-nouns-adjectives-pronouns/) as test cases. I3 is a measure in [12. Mova and Modern Hebrew: where it stands, what it would need](https://md.mova.elamur.ai/free/en/docs/languages/he/12-mova/), run on the open HeSum split only as a test set, never as training data. ## Cite The paper itself, not this card. BibTeX from the library's record of the work. [DOI 10.18653/v1/2024.loresmt-1.2](https://doi.org/10.18653/v1/2024.loresmt-1.2) ``` @inproceedings{mondshine2024hesum, title = {{HeSum: a Novel Dataset for Abstractive Text Summarization in Hebrew}}, author = {Mondshine, Itai and Paz-Argaman, Tzuf and Mordechai, Asaf Achi and Tsarfaty, Reut}, booktitle = {Proceedings of the Seventh Workshop on Technologies for Machine Translation of Low-Resource Languages (LoResMT 2024)}, year = {2024}, doi = {10.18653/v1/2024.loresmt-1.2}, url = {https://doi.org/10.18653/v1/2024.loresmt-1.2} } ``` - [← previous Revisiting "verbal agreement": The case of Israeli Hebrew](https://md.mova.elamur.ai/free/en/docs/papers/lingbulk-2022-shor-revisiting-verbal-agreement-case-israeli/) - [next → Verbal strategies for expressing reciprocity – the case of Hebrew](https://md.mova.elamur.ai/free/en/docs/papers/lingbulk-2024-siegal-verbal-strategies-expressing-reciprocity-case/) - [↑ back to Modern Hebrew](https://md.mova.elamur.ai/free/en/docs/papers/he/) ## References 4 references, 0 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet. 1. Kabir Ahuja, Rishav Hada, Millicent Ochieng, Prachi Jain, Harshita Diddee, Samuel Maina, Tanuja Ganu, Sameer Segal, Maxamed Axmed, Kalika Bali, et al. 2023. Mega: Multilingual evaluation of generative ai. arXiv preprint arXiv:2303.12528. [↗](https://arxiv.org/abs/2303.12528) 2. Google Translate API. 2023. Google translate api v2 documentation. [find](https://scholar.google.com/scholar?q=Google+Translate+API%2E+2023%2E+Google+translate+api+v2+documentation%2E) 3. Dan Bareket and Reut Tsarfaty. 2021. Neural modeling for named entities and morphology (nemo^2). Transactions of the Association for Computational Linguistics, 9:909–928. [find](https://scholar.google.com/scholar?q=Dan+Bareket+and+Reut+Tsarfaty%2E+2021%2E+Neural+modeling+for+named+entities+and+morphology+%28nemo%5E2%29%2E+Transactions+of+the+Association+for+Computational+Linguistics%2C+9%3A909%E2%80%93928%2E) 4. Ethics Yonatan Bisk, Rowan Zellers, Jianfeng Gao, Yejin Choi, et al. 2020. Piqa: Reasoning about physical commonsense in natural language. In Proceedings of the AAAI conference on artificial intelligence, volume 34, pages 7432–7439. [find](https://scholar.google.com/scholar?q=Ethics+Yonatan+Bisk%2C+Rowan+Zellers%2C+Jianfeng+Gao%2C+Yejin+Choi%2C+et+al%2E+2020%2E+Piqa%3A+Reasoning+about+physical+commonsense+in+natural+language%2E+In+Proceedings+of+the+AAAI+conference+on+artificial+intellige)