Elamur: **Mova** · [Parse](https://mova.elamur.ai/free/en/parse/) · [Dictionary](https://md.dictionary.elamur.ai/free/en/) · [Translate](https://md.translate.elamur.ai/free/en/) · [Research](https://md.research.elamur.ai/free/en/) · [MCP](https://mcp.elamur.ai/) · [Groupants](https://md.groupants.elamur.ai/free/en/)

[Mova](https://md.mova.elamur.ai/free/en/) · [this page in HTML](https://mova.elamur.ai/free/en/docs/tools/parsecmp/)

[home](https://md.mova.elamur.ai/free/en/) / [docs](https://md.mova.elamur.ai/free/en/docs/) / [tools](https://md.mova.elamur.ai/free/en/docs/tools/) / parsecmp — many parsers against the reference trees, and parser agreement

# parsecmp — many parsers against the reference trees, and parser agreement

How the parser collection is run: [Open parsers: witnesses and tests](https://md.mova.elamur.ai/free/en/docs/repo-docs/parsers/).

## Run

```
cargo build --release -p parsecmp
target/release/parsecmp <run dir>
target/release/parsecmp agree <dir> <a> <b> [<c>]
```

- `parsecmp <run dir>` compares every parser output under `<run dir>/out/` with the reference trees `in/haiku.conllu` (course per sentence in `in/course.txt`). Sentences are aligned by order; a sentence whose token count differs is skipped for that parser and counted. It writes `report.md`, `suspects.tsv` (tokens where a strong majority of parsers disagrees with the reference) and `per-course.tsv` into the run dir.
- `parsecmp agree` reads `<dir>/<a>/*.conllu`, `<dir>/<b>/*.conllu` (and `<c>`) for the same sentences and prints, per file, UAS and LAS (universal relation, punctuation left out) of each pair. Two witnesses that agree with each other but not with `a` point to `a` misreading the text; when the witnesses disagree too, the text is hard.

## Limits

The list of dependency systems is fixed in the code (the stronger ones only). Constituency outputs (`*.ptb`) are not compared with the reference; the report gives labelled bracket F1 between each pair of them. The reference trees are themselves teacher annotations, not gold. Agreement is evidence of difficulty or error, not a gold label.

- [← previous parallel — parallel texts in one TSV (English–French, English–Ukrainian, French–Ukrainian)](https://md.mova.elamur.ai/free/en/docs/tools/parallel/)
- [next → roundtrip — where each layer of Mova loses information](https://md.mova.elamur.ai/free/en/docs/tools/roundtrip/)
- [↑ back to tools](https://md.mova.elamur.ai/free/en/docs/tools/)