[Mova](https://md.mova.elamur.ai/free/en/) · [this page in HTML](https://mova.elamur.ai/free/en/docs/treebanks/hr/set/)

[home](https://md.mova.elamur.ai/free/en/) / [docs](https://md.mova.elamur.ai/free/en/docs/) / [treebanks](https://md.mova.elamur.ai/free/en/docs/treebanks/) / [hr](https://md.mova.elamur.ai/free/en/docs/treebanks/hr/) / UD_Croatian-SET

- [papers.md](https://md.mova.elamur.ai/free/en/docs/treebanks/hr/set/papers/) — Papers: UD_Croatian-SET

# UD_Croatian-SET

Treebank card from UD release 2.18: metadata and texts come from `UD_Croatian-SET/README.md`; size is counted by streaming the `.conllu` files and checked against the release `stats.xml`. Generated by `tools/treebanks build`; do not edit by hand. Papers: [Papers: UD_Croatian-SET](https://md.mova.elamur.ai/free/en/docs/treebanks/hr/set/papers/); seeds: `seeds/`; converter: `convert.md`.

| Field | Value |
| --- | --- |
| UD name | UD_Croatian-SET |
| Language | Croatian (`hr`) |
| Family | IE |
| Treebank code | `hr_set` |
| UD page | [universaldependencies.org/treebanks/hr set/index.html](https://universaldependencies.org/treebanks/hr_set/index.html) |
| License | CC BY-SA 4.0 |
| Genres | news, web, wiki |
| Text in data | yes |
| Parallel | set |
| In UD since | UD v1.1 |
| Authors | Tanja Samardžić; Aleksandra Miletić; Nikola Ljubešić; Željko Agić; Daniel Zeman |
| Contact | [tanja.samardzic@uzh.ch](mailto:tanja.samardzic@uzh.ch) |
| Development | outside the UD repo (elsewhere): fixes go to the source or the converter |

## Annotation layers

| Layer | Origin |
| --- | --- |
| Lemmas | converted from manual |
| UPOS | converted from manual |
| XPOS | manual native |
| Features | converted from manual |
| Relations | manual native |

UD scale: *manual native* — annotated by hand directly in UD; *converted from manual* — converted from manual annotation in another scheme; *converted with corrections* — converted and partly corrected by hand; *automatic with corrections* — automatic, with partial manual corrections; *automatic* — automatic; *not available* — the layer is absent.

## Size

| Split | Sentences | Tokens | Words | Multiword tokens | Empty nodes |
| --- | --- | --- | --- | --- | --- |
| train | 6 914 | 152 857 | 152 857 | 0 | 0 |
| dev | 960 | 22 292 | 22 292 | 0 | 0 |
| test | 1 136 | 24 260 | 24 260 | 0 | 0 |
| **total** | 9 010 | 199 409 | 199 409 | 0 | 0 |

Tokens are surface tokens (Spanish `vámonos` is one), words are syntactic words (`vamos` + `nos`); multiword tokens are those split into several words; empty nodes are the `N.M` nodes of the enhanced graph.

## Summary

> The Croatian UD treebank is based on the extension of the SETimes-HR corpus, the [hr500k](http://hdl.handle.net/11356/1183) corpus.

## Introduction

> The sentences are partially parallel with the smaller Serbian UD treebank, which comes from the Serbian edition of SETimes. For the UD release 2.4, the Croatian and Serbian corpus were enriched with `newdoc` metadata and re-split so that the corresponding documents are in the same section (train/dev/test) in Croatian and Serbian.
> 
> Sentence ids have also been changed to reflect the domain / source the data comes from, and not the dependence to one of the sections (train/dev/test), as was the case in previous releases.
> 
> ### Training set.
> 
> Contains 6,844 sentences (151,226 tokens) from three sources:
> 
> 1. sentence ids `set.hr*`: pseudorandom 80% of documents of newspaper text from the [Southeast European Times](http://en.wikipedia.org/wiki/Southeast_European_Times) news website, obtained from the [SETimes parallel corpus](http://nlp.ffzg.hr/resources/corpora/setimes/). This part of the treebank is built on top of the [SETimes.HR dependency treebank of Croatian](https://github.com/ffnlp/sethr);
> 2. sentence ids `news.hr*`: pseudorandom 80% of documents of Croatian news web sources.
> 3. sentence ids `web.hr*` : pseudorandom 80% of sentences of [Croatian web sources](http://nl.ijs.si/isjt14/proceedings/isjt2014_10.pdf).
> 
> ### Development set.
> 
> Contains 954 sentences (21,952 tokens) from three sources:
> 
> 1. sentence ids `set.hr*`: pseudorandom 10% of documents of newspaper text from the Southeast European Times.
> 2. sentence ids `news.hr*`: pseudorandom 10% of documents of Croatian news web sources.
> 3. sentence ids `web.hr*` : pseudorandom 10% of sentences of Croatian web sources.
> 
> ### Test set.
> 
> Contains 1214 sentences (26,263 tokens) from four sources:
> 
> 1. sentence ids `set.hr*`: pseudorandom 10% of documents of newspaper text from the Southeast European Times (+ the previous test set from the same source).
> 2. sentence ids `wiki.hr*`: old Wikipedia-based test set.
> 3. sentence ids `news.hr*`: pseudorandom 10% of documents of Croatian news web sources.
> 4. sentence ids `web.hr*` : pseudorandom 10% of sentences of Croatian web sources.
> 
> ### Details
> 
> Sentence and word segmentation was manually checked. The treebank does not include multiword tokens. No language-specific features and relations were used. The POS tags and features were converted from [Multext East v6](http://nl.ijs.si/ME/V6/msd/html/msd-hbs.html) (present in the XPOS column) and manually checked. The syntactic annotation was done manually.

- [↑ back to Croatian (hr) — UD 2.18 treebanks](https://md.mova.elamur.ai/free/en/docs/treebanks/hr/)