[Mova](https://md.mova.elamur.ai/free/en/) · [this page in HTML](https://mova.elamur.ai/free/en/docs/papers/findings-2023-cohen-heq-large-diverse-hebrew-reading/)

[home](https://md.mova.elamur.ai/free/en/) / [docs](https://md.mova.elamur.ai/free/en/docs/) / [papers](https://md.mova.elamur.ai/free/en/docs/papers/) / [Modern Hebrew](https://md.mova.elamur.ai/free/en/docs/papers/he/) / HeQ: a Large and Diverse Hebrew Reading Comprehension Benchmark

# HeQ: a Large and Diverse Hebrew Reading Comprehension Benchmark

**Authors:** [Amir DN Cohen](https://md.mova.elamur.ai/free/en/docs/papers/authors/amir-dn-cohen/); Hilla Merhav; [Yoav Goldberg](https://md.mova.elamur.ai/free/en/docs/papers/authors/yoav-goldberg/); [Reut Tsarfaty](https://md.mova.elamur.ai/free/en/docs/papers/authors/reut-tsarfaty/) · **Year:** 2023 · **Venue:** Findings of EMNLP 2023 **Link:** [aclanthology.org/2023.findings-emnlp.915](https://aclanthology.org/2023.findings-emnlp.915/) · library `findings-2023-cohen-heq-large-diverse-hebrew-reading` · **Licence:** [CC BY 4.0](https://creativecommons.org/licenses/by/4.0/) (ACL Anthology)

[**2** citations](https://openalex.org/works?filter=cites:W4389518697) openalex · 2026-10-18[**11** citations in our library](https://md.mova.elamur.ai/free/en/docs/papers/cited-by/findings-2023-cohen-heq-large-diverse-hebrew-reading/) of the 140673 papers whose bibliographies we read[Findings of the Association for Computational Linguistics: EMNLP 2023](https://aclanthology.org/volumes/2023.findings-emnlp/)[licence](https://creativecommons.org/licenses/by/4.0/)

- [Publisher's page](https://aclanthology.org/2023.findings-emnlp.915/)
- [PDF](https://aclanthology.org/2023.findings-emnlp.915.pdf)
- [DOI 10.18653/v1/2023.findings-emnlp.915](https://doi.org/10.18653/v1/2023.findings-emnlp.915)
- [OpenAlex](https://openalex.org/W4389518697)

**Authors (4)**

1. [Amir DN Cohen](https://openalex.org/A5086960141) [Semantic Scholar](https://www.semanticscholar.org/author/2112930221) · h 7 · 141 citations · 30 works
2. [Hilla Merhav](https://openalex.org/A5120717956) [Semantic Scholar](https://www.semanticscholar.org/author/2514138301) · h 1 · 2 citations · 2 works
3. [Yoav Goldberg](https://openalex.org/A5028476919) [ORCID](https://orcid.org/0000-0002-6497-829X) · [Semantic Scholar](https://www.semanticscholar.org/author/2261277914) · h 63 · 24540 citations · 401 works
4. [Reut Tsarfaty](https://openalex.org/A5063283689) [ORCID](https://orcid.org/0000-0001-6406-6568) · [Semantic Scholar](https://www.semanticscholar.org/author/2799181) · h 24 · 2886 citations · 217 works

Citations and author metrics from openalex (2026-10-18); authors with the same name are not always told apart.

## What it is about

HeQ is an extractive question-answering benchmark in the SQuAD style for Modern Hebrew: 30,147 question–answer pairs from Hebrew Wikipedia and from the Geektime tech news site. Crowd workers were trained one by one, and each question was graded as rejected, verified, good or gold (gold means it needs inference). The central point is the metric: a Hebrew clitic can make a whole answer one word, so a correct span can score 0 under word-level F1. The authors propose TLNLS, a token-level normalised Levenshtein similarity over whitespace tokens, and show it separates verified-correct from verified-wrong spans far better than F1 (positives 0.73 vs 0.58; negatives 0.09 vs 0.02). Among the models, multilingual BERT is best (TLNLS 78.2 on the test set), and ChatGPT is the worst. Going from 1.7K to the full training set adds 11.4 TLNLS points.

## Ideas

- I1. Use a TLNLS-style span score in Mova's own Hebrew answer tests: split on whitespace, take for each gold token its best normalised similarity to a predicted token, and average over the longer span. Report it next to F1, never alone.
- I2. Gate any span metric with a negative control: a set of wrong spans that a model actually produced, which the metric must score low. A scorer that cannot show red is not a gate.
- I3. For dates and numbers the character similarity gives partial credit to "1948" vs "1921" (0.5). The paper falls back to plain F1 when digits fill more than half the span; adopt the same rule.

## For Mova

I1–I3 go into the span-scoring helper of the test harness in `tools/hbo` and into the Modern Hebrew test plan in [12. Mova and Modern Hebrew: where it stands, what it would need](https://md.mova.elamur.ai/free/en/docs/languages/he/12-mova/). The boundary problem behind them is the clitic split discussed in [Nouns, adjectives, pronouns and numerals](https://md.mova.elamur.ai/free/en/docs/languages/he/04-nouns-adjectives-pronouns/).

## Cite

The paper itself, not this card. BibTeX from the library's record of the work. [DOI 10.18653/v1/2023.findings-emnlp.915](https://doi.org/10.18653/v1/2023.findings-emnlp.915)

```
@inproceedings{cohen2023heq,
  title = {{HeQ: a Large and Diverse Hebrew Reading Comprehension Benchmark}},
  author = {Cohen, Amir DN and Merhav, Hilla and Goldberg, Yoav and Tsarfaty, Reut},
  booktitle = {Findings of the Association for Computational Linguistics: EMNLP 2023},
  year = {2023},
  doi = {10.18653/v1/2023.findings-emnlp.915},
  url = {https://doi.org/10.18653/v1/2023.findings-emnlp.915}
}
```

- [← previous HeGeL: A Novel Dataset for Geo-Location from Hebrew Text](https://md.mova.elamur.ai/free/en/docs/papers/findings-2023-argaman-hegel-novel-dataset-geo-location/)
- [next → Multilingual Sequence-to-Sequence Models for Hebrew NLP](https://md.mova.elamur.ai/free/en/docs/papers/findings-2023-eyal-multilingual-sequence-sequence-models-hebrew/)
- [↑ back to Modern Hebrew](https://md.mova.elamur.ai/free/en/docs/papers/he/)

## References

27 references, 5 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Jonathan H. Clark, Eunsol Choi, Michael Collins, Dan Garrette, Tom Kwiatkowski, Vitaly Nikolaev, and Jennimaria Palomaki. 2020. TyDi QA: A benchmark for information-seeking question answering in typologically diverse languages. Transactions of the Association for Computational Linguistics, 8:454–470. [find](https://scholar.google.com/scholar?q=Jonathan+H%2E+Clark%2C+Eunsol+Choi%2C+Michael+Collins%2C+Dan+Garrette%2C+Tom+Kwiatkowski%2C+Vitaly+Nikolaev%2C+and+Jennimaria+Palomaki%2E+2020%2E+TyDi+QA%3A+A+benchmark+for+information%2Dseeking+question+answering+in+typol)
2. Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019. BERT: Pre-training of deep bidirectional transformers for language understanding. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers), pages 4171–4186, Minneapolis, Minnesota. Association for Computational Linguistics. [↗](https://doi.org/10.18653/v1/n19-1423)
3. Yanai Elazar, Nora Kassner, Shauli Ravfogel, Amir Feder, Abhilasha Ravichander, Marius Mosbach, Yonatan Belinkov, Hinrich Schütze, and Yoav Goldberg. 2022. Measuring Causal Effects of Data Statistics on Language Model’s ‘Factual’ Predictions. [find](https://scholar.google.com/scholar?q=Yanai+Elazar%2C+Nora+Kassner%2C+Shauli+Ravfogel%2C+Amir+Feder%2C+Abhilasha+Ravichander%2C+Marius+Mosbach%2C+Yonatan+Belinkov%2C+Hinrich+Sch%C3%BCtze%2C+and+Yoav+Goldberg%2E+2022%2E+Measuring+Causal+Effects+of+Data+Statistics+)
4. Jianfeng Gao, Michel Galley, and Lihong Li. 2018. Neural approaches to conversational AI. In 41st International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2018, pages 1371–1374. Association for Computing Machinery, Inc. [find](https://scholar.google.com/scholar?q=Jianfeng+Gao%2C+Michel+Galley%2C+and+Lihong+Li%2E+2018%2E+Neural+approaches+to+conversational+AI%2E+In+41st+International+ACM+SIGIR+Conference+on+Research+and+Development+in+Information+Retrieval%2C+SIGIR+2018%2C+p)
5. Eylon Guetta, Avi Shmidman, Shaltiel Shmidman, Cheyn Shmuel Shmidman, Joshua Guedalia, Moshe Koppel, Dan Bareket, Amit Seker, and Reut Tsarfaty. 2022. Large Pre-Trained Models with Extra-Large Vocabularies: A Contrastive Analysis of Hebrew BERT Models and a New One to Outperform Them All. Technical report. [find](https://scholar.google.com/scholar?q=Eylon+Guetta%2C+Avi+Shmidman%2C+Shaltiel+Shmidman%2C+Cheyn+Shmuel+Shmidman%2C+Joshua+Guedalia%2C+Moshe+Koppel%2C+Dan+Bareket%2C+Amit+Seker%2C+and+Reut+Tsarfaty%2E+2022%2E+Large+Pre%2DTrained+Models+with+Extra%2DLarge+Vocabul) [our card](https://md.mova.elamur.ai/free/en/docs/papers/hbo-2022-gueta-large-pre-trained-models-extra/)
6. Kelvin Guu, Kenton Lee, Zora Tung, Panupong Pasupat, and Ming-Wei Chang. 2020. Retrieval Augmented Language Model Pre-Training. In Proceedings of the 37th International Conference on Machine Learning, pages 3929–3938. PMLR. [find](https://scholar.google.com/scholar?q=Kelvin+Guu%2C+Kenton+Lee%2C+Zora+Tung%2C+Panupong+Pasupat%2C+and+Ming%2DWei+Chang%2E+2020%2E+Retrieval+Augmented+Language+Model+Pre%2DTraining%2E+In+Proceedings+of+the+37th+International+Conference+on+Machine+Learning%2C)
7. Lynette Hirschman, Marc Light, Eric Breck, and John D. Burger. 1999. Deep read: A reading comprehension system. In Proceedings of the 37th Annual Meeting of the Association for Computational Linguistics, pages 325–332, College Park, Maryland, USA. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Lynette+Hirschman%2C+Marc+Light%2C+Eric+Breck%2C+and+John+D%2E+Burger%2E+1999%2E+Deep+read%3A+A+reading+comprehension+system%2E+In+Proceedings+of+the+37th+Annual+Meeting+of+the+Association+for+Computational+Linguisti)
8. Robin Jia and Percy Liang. 2017. Adversarial examples for evaluating reading comprehension systems. In EMNLP 2017 - Conference on Empirical Methods in Natural Language Processing, Proceedings, pages 2021–2031. Association for Computational Linguistics (ACL). [find](https://scholar.google.com/scholar?q=Robin+Jia+and+Percy+Liang%2E+2017%2E+Adversarial+examples+for+evaluating+reading+comprehension+systems%2E+In+EMNLP+2017+%2D+Conference+on+Empirical+Methods+in+Natural+Language+Processing%2C+Proceedings%2C+pages+2) [our card](https://md.mova.elamur.ai/free/en/docs/papers/jia-2017-adversarial-examples-evaluating-reading-comprehension/)
9. Mandar Joshi, Danqi Chen, Yinhan Liu, Daniel S. Weld, Luke Zettlemoyer, and Omer Levy. 2020. Span-BERT: Improving Pre-training by Representing and Predicting Spans. Transactions of the Association for Computational Linguistics, 8:64–77. [find](https://scholar.google.com/scholar?q=Mandar+Joshi%2C+Danqi+Chen%2C+Yinhan+Liu%2C+Daniel+S%2E+Weld%2C+Luke+Zettlemoyer%2C+and+Omer+Levy%2E+2020%2E+Span%2DBERT%3A+Improving+Pre%2Dtraining+by+Representing+and+Predicting+Spans%2E+Transactions+of+the+Association+for)
10. Mandar Joshi, Eunsol Choi, Daniel Weld, and Luke Zettlemoyer. 2017. TriviaQA: A large scale distantly supervised challenge dataset for reading comprehension. In Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 1601–1611, Vancouver, Canada. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Mandar+Joshi%2C+Eunsol+Choi%2C+Daniel+Weld%2C+and+Luke+Zettlemoyer%2E+2017%2E+TriviaQA%3A+A+large+scale+distantly+supervised+challenge+dataset+for+reading+comprehension%2E+In+Proceedings+of+the+55th+Annual+Meeting+)
11. Omri Keren and Omer Levy. 2021. ParaShoot: A Hebrew question answering dataset. In Proceedings of the 3rd Workshop on Machine Reading for Question Answering, pages 106–112, Punta Cana, Dominican Republic. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Omri+Keren+and+Omer+Levy%2E+2021%2E+ParaShoot%3A+A+Hebrew+question+answering+dataset%2E+In+Proceedings+of+the+3rd+Workshop+on+Machine+Reading+for+Question+Answering%2C+pages+106%E2%80%93112%2C+Punta+Cana%2C+Dominican+Repub) [our card](https://md.mova.elamur.ai/free/en/docs/papers/ud-2021-keren-parashoot-hebrew-question-answering-dataset/)
12. Miyoung Ko, Jinhyuk Lee, Hyunjae Kim, Gangwoo Kim, and Jaewoo Kang. 2020. Look at the first sentence: Position bias in question answering. In EMNLP 2020 - 2020 Conference on Empirical Methods in Natural Language Processing, Proceedings of the Conference, pages 1109–1121. Association for Computational Linguistics (ACL). [find](https://scholar.google.com/scholar?q=Miyoung+Ko%2C+Jinhyuk+Lee%2C+Hyunjae+Kim%2C+Gangwoo+Kim%2C+and+Jaewoo+Kang%2E+2020%2E+Look+at+the+first+sentence%3A+Position+bias+in+question+answering%2E+In+EMNLP+2020+%2D+2020+Conference+on+Empirical+Methods+in+Natur)
13. Tom Kwiatkowski, Jennimaria Palomaki, Olivia Redfield, Michael Collins, Ankur Parikh, Chris Alberti, Danielle Epstein, Illia Polosukhin, Jacob Devlin, Kenton Lee, Kristina Toutanova, Llion Jones, Matthew Kelcey, Ming-Wei Chang, Andrew M. Dai, Jakob Uszkoreit, Quoc Le, and Slav Petrov. 2019. Natural questions: A benchmark for question answering research. Transactions of the Association for Computational Linguistics, 7:452–466. [find](https://scholar.google.com/scholar?q=Tom+Kwiatkowski%2C+Jennimaria+Palomaki%2C+Olivia+Redfield%2C+Michael+Collins%2C+Ankur+Parikh%2C+Chris+Alberti%2C+Danielle+Epstein%2C+Illia+Polosukhin%2C+Jacob+Devlin%2C+Kenton+Lee%2C+Kristina+Toutanova%2C+Llion+Jones%2C+Matt)
14. Zhenzhong Lan, Mingda Chen, Sebastian Goodman, Kevin Gimpel, Piyush Sharma, and Radu Soricut. 2019. ALBERT: A Lite BERT for Self-supervised Learning of Language Representations. [find](https://scholar.google.com/scholar?q=Zhenzhong+Lan%2C+Mingda+Chen%2C+Sebastian+Goodman%2C+Kevin+Gimpel%2C+Piyush+Sharma%2C+and+Radu+Soricut%2E+2019%2E+ALBERT%3A+A+Lite+BERT+for+Self%2Dsupervised+Learning+of+Language+Representations%2E)
15. Amir More, Amit Seker, Victoria Basmova, and Reut Tsarfaty. 2019. Joint transition-based models for morpho-syntactic parsing: Parsing strategies for MRLs and a case study from Modern Hebrew. Transactions of the Association for Computational Linguistics, 7:33–48. [find](https://scholar.google.com/scholar?q=Amir+More%2C+Amit+Seker%2C+Victoria+Basmova%2C+and+Reut+Tsarfaty%2E+2019%2E+Joint+transition%2Dbased+models+for+morpho%2Dsyntactic+parsing%3A+Parsing+strategies+for+MRLs+and+a+case+study+from+Modern+Hebrew%2E+Transacti) [our card](https://md.mova.elamur.ai/free/en/docs/papers/tacl-2019-more-joint-transition-based-models-morpho/)
16. Gonzalo Navarro. 2001. A guided tour to approximate string matching. ACM Computing Surveys, 33(1):31– 88. [find](https://scholar.google.com/scholar?q=Gonzalo+Navarro%2E+2001%2E+A+guided+tour+to+approximate+string+matching%2E+ACM+Computing+Surveys%2C+33%281%29%3A31%E2%80%93+88%2E)
17. Pranav Rajpurkar, Robin Jia, and Percy Liang. 2018a. Know what you don’t know: Unanswerable questions for SQuAD. In ACL 2018 - 56th Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference (Long Papers), volume 2, pages 784–789. [find](https://scholar.google.com/scholar?q=Pranav+Rajpurkar%2C+Robin+Jia%2C+and+Percy+Liang%2E+2018a%2E+Know+what+you+don%E2%80%99t+know%3A+Unanswerable+questions+for+SQuAD%2E+In+ACL+2018+%2D+56th+Annual+Meeting+of+the+Association+for+Computational+Linguistics%2C+Pro)
18. Pranav Rajpurkar, Robin Jia, and Percy Liang. 2018b. Know what you don’t know: Unanswerable questions for SQuAD. In ACL 2018 - 56th Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference (Long Papers), volume 2, pages 784–789. [find](https://scholar.google.com/scholar?q=Pranav+Rajpurkar%2C+Robin+Jia%2C+and+Percy+Liang%2E+2018b%2E+Know+what+you+don%E2%80%99t+know%3A+Unanswerable+questions+for+SQuAD%2E+In+ACL+2018+%2D+56th+Annual+Meeting+of+the+Association+for+Computational+Linguistics%2C+Pro)
19. Pranav Rajpurkar, Jian Zhang, Konstantin Lopyrev, and Percy Liang. 2016a. SQuad: 100,000+ questions for machine comprehension of text. In EMNLP 2016 - Conference on Empirical Methods in Natural Language Processing, Proceedings, pages 2383–2392. [find](https://scholar.google.com/scholar?q=Pranav+Rajpurkar%2C+Jian+Zhang%2C+Konstantin+Lopyrev%2C+and+Percy+Liang%2E+2016a%2E+SQuad%3A+100%2C000%2B+questions+for+machine+comprehension+of+text%2E+In+EMNLP+2016+%2D+Conference+on+Empirical+Methods+in+Natural+Langua)
20. Pranav Rajpurkar, Jian Zhang, Konstantin Lopyrev, and Percy Liang. 2016b. SQuAD: 100,000+ questions for machine comprehension of text. In Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, pages 2383–2392, Austin, Texas. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Pranav+Rajpurkar%2C+Jian+Zhang%2C+Konstantin+Lopyrev%2C+and+Percy+Liang%2E+2016b%2E+SQuAD%3A+100%2C000%2B+questions+for+machine+comprehension+of+text%2E+In+Proceedings+of+the+2016+Conference+on+Empirical+Methods+in+Nat)
21. Siva Reddy, Danqi Chen, and Christopher D. Manning. 2019. CoQA: A conversational question answering challenge. Transactions of the Association for Computational Linguistics, 7:249–266. [find](https://scholar.google.com/scholar?q=Siva+Reddy%2C+Danqi+Chen%2C+and+Christopher+D%2E+Manning%2E+2019%2E+CoQA%3A+A+conversational+question+answering+challenge%2E+Transactions+of+the+Association+for+Computational+Linguistics%2C+7%3A249%E2%80%93266%2E)
22. Marc-Antoine Rondeau and T. J. Hazen. 2018. Systematic error analysis of the Stanford question answering dataset. In Proceedings of the Workshop on Machine Reading for Question Answering, pages 12–20, Melbourne, Australia. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Marc%2DAntoine+Rondeau+and+T%2E+J%2E+Hazen%2E+2018%2E+Systematic+error+analysis+of+the+Stanford+question+answering+dataset%2E+In+Proceedings+of+the+Workshop+on+Machine+Reading+for+Question+Answering%2C+pages+12%E2%80%9320%2C)
23. Sebastian Ruder and Avirup Sil. 2021. Multi-Domain Multilingual Question Answering. In EMNLP 2021 -2021 Conference on Empirical Methods in Natural Language Processing: Tutorial Abstracts, pages 17– 21. [find](https://scholar.google.com/scholar?q=Sebastian+Ruder+and+Avirup+Sil%2E+2021%2E+Multi%2DDomain+Multilingual+Question+Answering%2E+In+EMNLP+2021+%2D2021+Conference+on+Empirical+Methods+in+Natural+Language+Processing%3A+Tutorial+Abstracts%2C+pages+17%E2%80%93+21)
24. Amit Seker, Elron Bandel, Dan Bareket, Idan Brusilovsky, Refael Greenfeld, and Reut Tsarfaty. 2022. AlephBERT: Language model pre-training and evaluation from sub-word to sentence level. In Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 46–56, Dublin, Ireland. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Amit+Seker%2C+Elron+Bandel%2C+Dan+Bareket%2C+Idan+Brusilovsky%2C+Refael+Greenfeld%2C+and+Reut+Tsarfaty%2E+2022%2E+AlephBERT%3A+Language+model+pre%2Dtraining+and+evaluation+from+sub%2Dword+to+sentence+level%2E+In+Proceeding) [our card](https://md.mova.elamur.ai/free/en/docs/papers/acl-2022-seker-alephbert-language-model-pre-training/)
25. Kazutoshi Shinoda, Saku Sugawara, and Akiko Aizawa. 2022. Look to the right: Mitigating relative position bias in extractive question answering. In Proceedings of the Fifth BlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP, pages 418–425, Abu Dhabi, United Arab Emirates (Hybrid). Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Kazutoshi+Shinoda%2C+Saku+Sugawara%2C+and+Akiko+Aizawa%2E+2022%2E+Look+to+the+right%3A+Mitigating+relative+position+bias+in+extractive+question+answering%2E+In+Proceedings+of+the+Fifth+BlackboxNLP+Workshop+on+Ana)
26. Adam Trischler, Tong Wang, Xingdi Yuan, Justin Harris, Alessandro Sordoni, Philip Bachman, and Kaheer Suleman. 2017. NewsQA: A machine comprehension dataset. In Proceedings of the 2nd Workshop on Representation Learning for NLP, pages 191–200, Vancouver, Canada. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Adam+Trischler%2C+Tong+Wang%2C+Xingdi+Yuan%2C+Justin+Harris%2C+Alessandro+Sordoni%2C+Philip+Bachman%2C+and+Kaheer+Suleman%2E+2017%2E+NewsQA%3A+A+machine+comprehension+dataset%2E+In+Proceedings+of+the+2nd+Workshop+on+Repr)
27. Chunting Zhou, Pengfei Liu, Puxin Xu, Srini Iyer, Jiao Sun, Yuning Mao, Xuezhe Ma, Avia Efrat, Ping Yu, Lili Yu, Susan Zhang, Gargi Ghosh, Mike Lewis, Luke Zettlemoyer, and Omer Levy. 2023. LIMA: Less Is More for Alignment. [find](https://scholar.google.com/scholar?q=Chunting+Zhou%2C+Pengfei+Liu%2C+Puxin+Xu%2C+Srini+Iyer%2C+Jiao+Sun%2C+Yuning+Mao%2C+Xuezhe+Ma%2C+Avia+Efrat%2C+Ping+Yu%2C+Lili+Yu%2C+Susan+Zhang%2C+Gargi+Ghosh%2C+Mike+Lewis%2C+Luke+Zettlemoyer%2C+and+Omer+Levy%2E+2023%2E+LIMA%3A+Less)