[Mova](https://md.mova.elamur.ai/free/en/) · [this page in HTML](https://mova.elamur.ai/free/en/docs/treebanks/he/iahltwiki/)

[home](https://md.mova.elamur.ai/free/en/) / [docs](https://md.mova.elamur.ai/free/en/docs/) / [treebanks](https://md.mova.elamur.ai/free/en/docs/treebanks/) / [he](https://md.mova.elamur.ai/free/en/docs/treebanks/he/) / UD_Hebrew-IAHLTwiki

- [papers.md](https://md.mova.elamur.ai/free/en/docs/treebanks/he/iahltwiki/papers/) — Papers: UD_Hebrew-IAHLTwiki

# UD_Hebrew-IAHLTwiki

Treebank card from UD release 2.18: metadata and texts come from `UD_Hebrew-IAHLTwiki/README.md`; size is counted by streaming the `.conllu` files and checked against the release `stats.xml`. Generated by `tools/treebanks build`; do not edit by hand. Papers: [Papers: UD_Hebrew-IAHLTwiki](https://md.mova.elamur.ai/free/en/docs/treebanks/he/iahltwiki/papers/); seeds: `seeds/`; converter: `convert.md`.

| Field | Value |
| --- | --- |
| UD name | UD_Hebrew-IAHLTwiki |
| Language | Hebrew (`he`) |
| Family | Afro-Asiatic |
| Treebank code | `he_iahltwiki` |
| UD page | [universaldependencies.org/treebanks/he iahltwiki/index.html](https://universaldependencies.org/treebanks/he_iahltwiki/index.html) |
| License | CC BY-SA 4.0 |
| Genres | wiki |
| Text in data | yes |
| Parallel | no |
| In UD since | UD v2.10 |
| Authors | Amir Zeldes; Avner Algom; Noam Ordan; Yifat Ben Moshe; Shira Wigderson |
| Contact | [amir.zeldes@georgetown.edu](mailto:amir.zeldes@georgetown.edu) |
| Development | in the UD repo (here) |

## Annotation layers

| Layer | Origin |
| --- | --- |
| Lemmas | manual native |
| UPOS | manual native |
| XPOS | not available |
| Features | manual native |
| Relations | manual native |

UD scale: *manual native* — annotated by hand directly in UD; *converted from manual* — converted from manual annotation in another scheme; *converted with corrections* — converted and partly corrected by hand; *automatic with corrections* — automatic, with partial manual corrections; *automatic* — automatic; *not available* — the layer is absent.

## Size

| Split | Sentences | Tokens | Words | Multiword tokens | Empty nodes |
| --- | --- | --- | --- | --- | --- |
| train | 4 298 | 88 528 | 120 832 | 29 807 | 0 |
| dev | 348 | 6 918 | 9 395 | 2 281 | 0 |
| test | 393 | 7 949 | 10 734 | 2 604 | 0 |
| **total** | 5 039 | 103 395 | 140 961 | 34 692 | 0 |

Tokens are surface tokens (Spanish `vámonos` is one), words are syntactic words (`vamos` + `nos`); multiword tokens are those split into several words; empty nodes are the `N.M` nodes of the enhanced graph.

## Summary

> Publicly available subset of the IAHLT UD Hebrew Treebank's Wikipedia section ([iahlt.org](https://www.iahlt.org/))

## Introduction

> The UD Hebrew-IAHLTWiki treebank consists of 5,000 contemporary Hebrew sentences representing a variety of texts originating from Wikipedia entries, compiled by the [Israeli Association of Human Language Technology](https://www.iahlt.org/). It includes various text domains, such as: biography, law, finance, health, places, events and miscellaneous. The schema for the UD Hebrew-IAHLT treebank, from which the publicly available UD Hebrew-IAHLTWiki subset is derived, is based on the conversion of the Hebrew Treebank (HTB) into the latest UD V2 and is checked against the Universal Dependencies validator as of UD release V2.10, in addition to a range of additional validations using the grewv tool.
> 
> ## Compatible datasets
> 
> The HTB version used in the project was initially converted automatically, then a subset of the converted data was manually validated and adopted as a gold standard for training the model for UD parsing used in Hebrew-IAHLT. The entire parsed data has been manually edited to correct parsing errors, and was automatically QA'ed to apply corrections following updates in the schema. For a fork of UD_Hebrew-HTB (Ha'aretz newswire data) using the same annotation scheme, see:
> 
> [github.com/IAHLT/UD Hebrew](https://github.com/IAHLT/UD_Hebrew)
> 
> For an additional UD_Hebrew corpus with the same annotation scheme (spoken parliament proceedings), see:
> 
> [github.com/UniversalDependencies/UD Hebrew-IAHLTknesset](https://github.com/UniversalDependencies/UD_Hebrew-IAHLTknesset)
> 
> ## NER annotations
> 
> The data additionally contains *nested* Named Entity annotations in the IAHLT scheme in the MISC annotation `Entity=`, illustrated in the following excerpt:
> 
> ```
> # sent_id = iahltwiki_piskat-hitgabrut-27
> # text = ההצעה תאמה את עמדתו של נשיא בית המשפט העליון אהרן ברק, היא נדונה בוועדת חוקה חוק ומשפט של הכנסת אך לא קודמה.
> 1-2	ההצעה	_	_	_	_	_	_	_	_
> 1	ה	ה	DET	DET	Definite=Def|PronType=Art	2	det	_	_
> 2	הצעה	הצעה	NOUN	NOUN	Gender=Fem|Number=Sing	3	nsubj	_	_
> 3	תאמה	תאם	VERB	VERB	Gender=Fem|HebBinyan=PAAL|Number=Sing|Person=3|Tense=Past|Voice=Act	0	root	_	_
> 4	את	את	ADP	ADP	_	5	case	_	_
> 5-6	עמדתו	_	_	_	_	_	_	_	_
> 5	עמדת	עמדה	NOUN	NOUN	Gender=Fem|Number=Sing	3	obj	_	_
> 6	ו	הוא	PRON	PRON	Case=Gen|Definite=Def|Gender=Masc|Number=Sing|Person=3|Poss=Yes|PronType=Prs	5	nmod:poss	_	_
> 7	של	של	ADP	ADP	Case=Gen	8	case	_	_
> 8	נשיא	נשיא	NOUN	NOUN	Definite=Cons|Gender=Masc|Number=Sing	5	nmod:poss	_	Entity=(TTL
> 9	בית	בית	NOUN	NOUN	Definite=Cons|Gender=Masc|Number=Sing	8	compound	_	Entity=(ORG
> 10-11	המשפט	_	_	_	_	_	_	_	_
> 10	ה	ה	DET	DET	Definite=Def|PronType=Art	11	det	_	_
> 11	משפט	משפט	NOUN	NOUN	Gender=Masc|Number=Sing	9	compound	_	_
> 12-13	העליון	_	_	_	_	_	_	_	_
> 12	ה	ה	DET	DET	Definite=Def|PronType=Art	13	det	_	_
> 13	עליון	עליון	ADJ	ADJ	Gender=Masc|Number=Sing	9	amod	_	Entity=ORG)TTL)
> 14	אהרן	אהרן	PROPN	PROPN	_	8	appos	_	Entity=(PER
> 15	ברק	ברק	PROPN	PROPN	_	14	flat	_	Entity=PER)|SpaceAfter=No
> ```
> 
> Entity types cover the following categories:
> 
> - ANG - language
> - DUC - product
> - EVE - event
> - FAC - facility
> - GPE - geo-political entity
> - LOC - location
> - ORG - organization
> - PER - person
> - TIMEX - time expression
> - TTL - title
> - WOA - work of art
> - MISC - miscellaneous

- [← previous UD_Hebrew-IAHLTknesset](https://md.mova.elamur.ai/free/en/docs/treebanks/he/iahltknesset/)
- [next → UD_Hebrew-PostRab](https://md.mova.elamur.ai/free/en/docs/treebanks/he/postrab/)
- [↑ back to Hebrew (he) — UD 2.18 treebanks](https://md.mova.elamur.ai/free/en/docs/treebanks/he/)