[Mova](https://md.mova.elamur.ai/free/en/) · [this page in HTML](https://mova.elamur.ai/free/en/docs/treebanks/nds/lsdc/) [home](https://md.mova.elamur.ai/free/en/) / [docs](https://md.mova.elamur.ai/free/en/docs/) / [treebanks](https://md.mova.elamur.ai/free/en/docs/treebanks/) / [nds](https://md.mova.elamur.ai/free/en/docs/treebanks/nds/) / UD_Low_Saxon-LSDC - [papers.md](https://md.mova.elamur.ai/free/en/docs/treebanks/nds/lsdc/papers/) — Papers: UD_Low_Saxon-LSDC # UD_Low_Saxon-LSDC Treebank card from UD release 2.18: metadata and texts come from `UD_Low_Saxon-LSDC/README.md`; size is counted by streaming the `.conllu` files and checked against the release `stats.xml`. Generated by `tools/treebanks build`; do not edit by hand. Papers: [Papers: UD_Low_Saxon-LSDC](https://md.mova.elamur.ai/free/en/docs/treebanks/nds/lsdc/papers/); seeds: `seeds/`; converter: `convert.md`. | Field | Value | | --- | --- | | UD name | UD_Low_Saxon-LSDC | | Language | Low Saxon (`nds`) | | Family | IE | | Treebank code | `nds_lsdc` | | UD page | [universaldependencies.org/treebanks/nds lsdc/index.html](https://universaldependencies.org/treebanks/nds_lsdc/index.html) | | License | CC BY-SA 4.0 | | Genres | fiction, nonfiction | | Text in data | yes | | Parallel | no | | In UD since | UD v2.8 | | Authors | Janine Siewert | | Contact | [janine.siewert@helsinki.fi](mailto:janine.siewert@helsinki.fi) | | Development | outside the UD repo (elsewhere): fixes go to the source or the converter | ## Annotation layers | Layer | Origin | | --- | --- | | Lemmas | manual native | | UPOS | manual native | | XPOS | manual native | | Features | manual native | | Relations | manual native | UD scale: *manual native* — annotated by hand directly in UD; *converted from manual* — converted from manual annotation in another scheme; *converted with corrections* — converted and partly corrected by hand; *automatic with corrections* — automatic, with partial manual corrections; *automatic* — automatic; *not available* — the layer is absent. ## Size | Split | Sentences | Tokens | Words | Multiword tokens | Empty nodes | | --- | --- | --- | --- | --- | --- | | train | 500 | 11 666 | 11 666 | 0 | 0 | | test | 500 | 10 949 | 10 973 | 15 | 0 | | **total** | 1 000 | 22 615 | 22 639 | 15 | 0 | Tokens are surface tokens (Spanish `vámonos` is one), words are syntactic words (`vamos` + `nos`); multiword tokens are those split into several words; empty nodes are the `N.M` nodes of the enhanced graph. Splits dev are absent from the release. ## Summary > The UD Low Saxon LSDC dataset consists of sentences in 8 major Low Saxon dialect groups from both Germany and the Netherlands. These sentences are (or are to become) part of the LSDC dataset and represent the language from mostly the 19th and early 20th century in genres such as short stories, novels, speeches, letters and fairytales. ## Introduction > The first version of the UD Low Saxon LSDC dataset contained 18 Low Saxon (sub-)dialects from both Germany and the Netherlands represented by 2 sentences each and belonging to the domains of short stories, novels, speeches, letters and fairytales. Each sentence was chosen from a different text to present some of the variation within the different dialect groups. In the second version, 40 sentences from four Westphalian dialects, two from Germany and two from the Netherlands, were added. The coverage of other dialect groups will be improved in future releases. For the third version, we have raised the number of sentences to 190 and made slight modifications to the subgrouping of the dialects. The **current fourth version** of the dataset contains 1,000 sentences, of which 500 are placed in the train and 500 in the test set. The dialect distribution between the train and the test set is not balanced yet and we plan to improve this in future releases. > > The major dialect group is shown as the third segment of the sentence ID. The following dialects are included: > > - BRA = Brandenburgish > - DNS = German North Saxon > - DWF = German Westphalian > - MVP = Mecklenburgish – West Pomeranian > - NNS = Dutch North Saxon > - NPR = Low Prussian > - NWF = Dutch Westphalian > - OFL = Eastphalian > > Since there is no official interregional spelling, the interregional spelling suggestion used by e.g. the Dutch Low Saxon Wikipedia (*Nysassiske Skryvwyse*, described in more detail here: [skryvwyse.eu](https://skryvwyse.eu/) (only in Low Saxon)) is used as a compromise for normalisation, but the original spelling of the source is included in the line "text_orig =" and a Middle Low Saxon lemma is added in the tenth column ("lemma_gml=xxx") in order to make the Modern Low Saxon data more easily comparable with the Middle Low Saxon data in the reference corpus "Referenzkorpus Mittelniederdeutsch/Niederrheinisch". For this reason, the Middle Low Saxon lemma forms largely follow the "Mittelniederdeutsches Handwörterbuch" by Agathe Lasch et al. like in the reference corpus. Middle Low Saxon lemmata are only added in the cases where there is an attestation in Middle Low Saxon, i.e. the word is either listed in the Handwörterbuch or is found in the reference corpus. Middle Low Saxon lemmata are still included if the word's meaning has changed, an in addition, we have done our best to create new complex word lemmata from known simplex words and reconstruct potential Middle Low Saxon forms for words which have not yet been attested at that stage of the language. The last few hundred sentences in the train set either do not contain Middle Low Saxon lemmata yet or they have been done automatically. > > The first version of the dataset contained only sentences from copyright-free material from the 19th and early 20th century. Part of the sentences are already included in the first release of the LSDC dataset found here: [github.com/Helsinki-NLP/LSDC](https://github.com/Helsinki-NLP/LSDC/) See there for further information on the origin of the data. The other sentences originate mostly from Joh. A. Leopold's work 'Van de Schelde tot te Weichsel', a digitised version of which is accessible here: [dbnl.org/titels/titel.php?id=leop008sche00](https://www.dbnl.org/titels/titel.php?id=leop008sche00) An exception constitutes the text 'Krisjaon Klaover' to be found in the Twentse Taalbank: [twentsetaalbank.nl/docs/TWA.1894-Heinink-Krisjaon Klaover-150.pdf](http://www.twentsetaalbank.nl/docs/TWA.1894-Heinink-Krisjaon_Klaover-150.pdf) These other sentences will be added to the next release of the LSDC dataset. Starting from the third version, the dataset also contains a few sentences from works by modern authors from which we have received permission to include small parts of their work in annotated corpora. - [↑ back to Low Saxon (nds) — UD 2.18 treebanks](https://md.mova.elamur.ai/free/en/docs/treebanks/nds/)