[Mova](https://md.mova.elamur.ai/free/en/) · [this page in HTML](https://mova.elamur.ai/free/en/docs/papers/lex-2026-philippov-english-wsd-labels/)

[home](https://md.mova.elamur.ai/free/en/) / [docs](https://md.mova.elamur.ai/free/en/docs/) / [papers](https://md.mova.elamur.ai/free/en/docs/papers/) / [English](https://md.mova.elamur.ai/free/en/docs/papers/en/) / English Word Sense Disambiguation in 2026: When the Labels Become the Bottleneck

# English Word Sense Disambiguation in 2026: When the Labels Become the Bottleneck

**Authors:** Vassili Philippov, Amro Salman, Dmitrii Andreev et al. · **Year:** 2026 · **Venue:** arXiv preprint (arXiv:2609.17554) **Link:** [arxiv.org/abs/2609.17554](https://arxiv.org/abs/2609.17554) · **Licence:** arXiv non-exclusive licence — summary only

[**0** citations](https://openalex.org/works?filter=cites:W7213505193) openalex · 2026-10-18[arXiv:2609.17554 (2026)](https://openalex.org/S4306400194)[licence](https://arxiv.org/licenses/nonexclusive-distrib/1.0/license.html)

- [Publisher's page](https://arxiv.org/abs/2609.17554)
- [PDF](https://arxiv.org/pdf/2609.17554v1)
- [arXiv 2609.17554](https://arxiv.org/abs/2609.17554)
- [OpenAlex](https://openalex.org/W7213505193)

**Authors (5)**

1. [Vassili Philippov](https://openalex.org/A5139806915) h 0 · 0 citations · 3 works
2. [Amro Salman](https://openalex.org/A5152025806) h 0 · 0 citations · 1 works
3. [Dmitrii Andreev](https://openalex.org/A5139808460) h 0 · 0 citations · 2 works
4. [Penny Hands](https://openalex.org/A5091134764) h 2 · 7 citations · 4 works
5. Emil Kaiumov et al.

Citations and author metrics from openalex (2026-10-18); authors with the same name are not always told apart.

## What it is about

The paper argues that on English all-words WSD the gold labels now limit the measured ranking, because frontier LLMs are close to the labels. The authors build lexEN-v1, a correction layer over the Maru et al. 2022 ALL_NEW benchmark (211 labels changed, 56 removed), and an evaluation harness with 57 models and 192 runs. On lexEN-v1 the best model reaches 95.6%, while the classic supervised systems sit near 80 to 85%. Fleiss kappa among three reviewers is 0.537 on the hard items, and coarser sense inventories raise agreement and accuracy together. Relabeling SemCor with two LLMs changes 21.30% (GPT-5.5) and 21.85% (Gemma) of the gold keys, and retraining the classic systems on it adds several F1 points on untouched test sets.

## Ideas

- I1. `onto/src/wsd.rs`: keep a lineage record for every sense label that `annot` or a rule changes (who or what changed it, the evidence, the date). Measure how many labels in a silver set change after a review pass, before any model is tuned on them.
- I2. Coarse check in `onto`: score the deterministic WSD at WordNet lexfile (supersense) level next to the fine sense level on the same test items. The paper reports coarsening lifts agreement and accuracy together; check whether the same holds for the deterministic system.
- I3. Relabeling pilot in `annot`: relabel a small sample of `en` silver senses with a large model offline and measure the disagreement rate by part of speech. The paper finds verbs disagree most (about 30%), so verbs should be reviewed first.

## For Mova

The touch points are `onto/src/wsd.rs` and the `annot` teacher side, which may relabel offline but never answers at test time. lexEN and SenseBench are research or test data with unclear licences, so use them for tests only. Measure first the coarse-versus-fine gap of the deterministic WSD on a held-out sample, with a second identical run to rule out noise.

Topics: [Word sense disambiguation](https://md.mova.elamur.ai/free/en/docs/papers/topics/word-sense-disambiguation/)

## Cite

The paper itself, not this card. BibTeX from the library's record of the work. [arXiv 2609.17554](https://arxiv.org/abs/2609.17554)

```
@misc{philippov2026english,
  title = {{English Word Sense Disambiguation in 2026: When the Labels Become the Bottleneck}},
  author = {Philippov, Vassili and Salman, Amro and Andreev, Dmitrii and Hands, Penny},
  year = {2026},
  eprint = {2609.17554},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2609.17554}
}
```

- [← previous Open English NameNet: Extending English Wordnet with Names](https://md.mova.elamur.ai/free/en/docs/papers/lex-2026-mccrae-open-english-namenet/)
- [next → An Expert Lexicon Approach to Identifying English Phrasal Verbs](https://md.mova.elamur.ai/free/en/docs/papers/li-2003-expert-lexicon-approach-identifying-english/)
- [↑ back to English](https://md.mova.elamur.ai/free/en/docs/papers/en/)
