[Mova](https://md.mova.elamur.ai/free/en/) · [this page in HTML](https://mova.elamur.ai/free/en/docs/treebanks/yi/yitb/)

[home](https://md.mova.elamur.ai/free/en/) / [docs](https://md.mova.elamur.ai/free/en/docs/) / [treebanks](https://md.mova.elamur.ai/free/en/docs/treebanks/) / [yi](https://md.mova.elamur.ai/free/en/docs/treebanks/yi/) / UD_Yiddish-YiTB

- [papers.md](https://md.mova.elamur.ai/free/en/docs/treebanks/yi/yitb/papers/) — Papers: UD_Yiddish-YiTB

# UD_Yiddish-YiTB

Treebank card from UD release 2.18: metadata and texts come from `UD_Yiddish-YiTB/README.md`; size is counted by streaming the `.conllu` files and checked against the release `stats.xml`. Generated by `tools/treebanks build`; do not edit by hand. Papers: [Papers: UD_Yiddish-YiTB](https://md.mova.elamur.ai/free/en/docs/treebanks/yi/yitb/papers/); seeds: `seeds/`; converter: `convert.md`.

| Field | Value |
| --- | --- |
| UD name | UD_Yiddish-YiTB |
| Language | Yiddish (`yi`) |
| Family | IE |
| Treebank code | `yi_yitb` |
| UD page | [universaldependencies.org/treebanks/yi yitb/index.html](https://universaldependencies.org/treebanks/yi_yitb/index.html) |
| License | CC BY-SA 4.0 |
| Genres | grammar-examples, learner-essays, bible, wiki, fiction, nonfiction, spoken, web |
| Text in data | yes |
| Parallel | no |
| In UD since | UD v2.17 |
| Authors | Kirk Andrews |
| Contact | [m.kirkandrews@gmail.com](mailto:m.kirkandrews@gmail.com) |
| Development | in the UD repo (here) |

## Annotation layers

| Layer | Origin |
| --- | --- |
| Lemmas | automatic |
| UPOS | manual native |
| XPOS | not available |
| Features | not available |
| Relations | manual native |

UD scale: *manual native* — annotated by hand directly in UD; *converted from manual* — converted from manual annotation in another scheme; *converted with corrections* — converted and partly corrected by hand; *automatic with corrections* — automatic, with partial manual corrections; *automatic* — automatic; *not available* — the layer is absent.

## Size

| Split | Sentences | Tokens | Words | Multiword tokens | Empty nodes |
| --- | --- | --- | --- | --- | --- |
| train | 1 877 | 16 227 | 16 458 | 231 | 0 |
| dev | 157 | 1 855 | 1 873 | 18 | 0 |
| test | 1 079 | 9 872 | 10 017 | 145 | 0 |
| **total** | 3 113 | 27 954 | 28 348 | 394 | 0 |

Tokens are surface tokens (Spanish `vámonos` is one), words are syntactic words (`vamos` + `nos`); multiword tokens are those split into several words; empty nodes are the `N.M` nodes of the enhanced graph.

## Summary

> YiTB is a treebank of linguistically annotated Yiddish data in the Universal Dependencies framework, created via a bootstraping machine learning method. A total of 27,872 tokens are currently in the treebank from a variety of sources and textual genres.

## Introduction

> Yiddish is classified as a West Germanic language, although it includes many elements from Semitic and Slavic languages as well. It is written in a modified Hebrew alphabet. Yiddish is structurally similiar to German, but it also consists of many interesting structures not found in other Germanic languages, such as periphrastic verbs.
> 
> There are a total of 27,872 tokens in the treebank. Roughly 60% of these stem from the Tatoeba source and consist of short sentences provided by both native and non-native speakers of Yiddish. It must be noted that there are occasional grammatical errors in these sentences, such as the use of the auxiliary *zayn* 'be' instead of *hobn* 'have' in past tense constructions of periphrastic verbs formed with the verb *zayn*, as well as incorrect syntax of periphrastic verbs which have an underlying complement-head (OV) order and do not follow the typical order expected of an SVO language like Yiddish. This appears to be a common mistake of intermediate L2 Yiddish speakers. The remainder 40% of tokens stem from a variety of native speaker texts and genres. The various source texts and genres are shown below.
> 
> Lemmas and transliterations into Latin script are provided as well by self-made models but are not 100% accurate. The transliteration model, which can be accessed [here](https://huggingface.co/shoowadoo/galkhesnet), was trained on wiktionary and transliterated Bible data. The lemmatization model was trained on wiktionary data and can be found [here](https://huggingface.co/shoowadoo/yiddish-lemmas). Rough translations have been provided using a model trained on Tatoeba sentences and parallel Bible verses that is accessible [here](https://huggingface.co/shoowadoo/m2m100-finetuned-yi-to-en_418M_2). Many of these translations need manual correction, and that process is underway. Morphological features are also not included at this time.
> 
> | Source | Author | Genre | Added | Split |
> | --- | --- | --- | --- | --- |
> | tatoeba.org | Various | grammar/learner | 2.17 | all |
> | Book of Exodus | Yehoyesh translation | bible | 2.17 | all |
> | Beethoven's Moonlight Sonata | Shloyme Bas­tom­s­ki | fiction | 2.17 | train |
> | Yiddish proverbs | Various | proverb | 2.17 | all |
> | Haggadahs and Elijah the Prophet | Proste Yiddish | web | 2.17 | test |
> | Bulletin No. 3: At the Border | Various | nonfiction | 2.17 | test |
> | A Story with a Cat and Yiddish Dialects | Proste Yiddish | web | 2.17 | dev |
> | Sholem Aleichem | Proste Yiddish | web | 2.17 | train |
> | Hirshke Glik | Shmerke Kaczerginski | nonfiction | 2.17 | dev |
> | Book of Proverbs | Yehoyesh translation | bible | 2.17 | test |
> | Shavuot and an Old Joke | Proste Yiddish | web | 2.17 | test |
> | Bankrupt | Katie Brown | fiction | 2.17 | train |
> | Jews and Yiddish | Nokhem Shtif | nonfiction | 2.17 | train |
> | Fathers and Children | Chaim Malitz | nonfiction | 2.17 | train |
> | Wikipedia | Various | nonfiction | 2.17 | train |
> | A Foolish Child | Jacob Dinezon | fiction | 2.17 | test |
> | From the Land of Consumption | Shloyme Gilbert | fiction | 2.17 | dev |
> | The Four Questions | Traditional | liturgical | 2.17 | test |
> | A Bit of Clarity and Simplicity Regarding the Language Question | Hillel Zeitlin | nonfiction | 2.17 | train |
> | Song of Songs | Yehoyesh translation | bible | 2.17 | train |
> | Yiddish: Volume 1 | Sheva Zucker | grammar | 2.18 | train |

- [↑ back to Yiddish (yi) — UD 2.18 treebanks](https://md.mova.elamur.ai/free/en/docs/treebanks/yi/)