[Mova](https://md.mova.elamur.ai/free/en/) · [this page in HTML](https://mova.elamur.ai/free/en/docs/papers/nagata-2018-pos-tagging-model-adapted-learner/)

[home](https://md.mova.elamur.ai/free/en/) / [docs](https://md.mova.elamur.ai/free/en/docs/) / [papers](https://md.mova.elamur.ai/free/en/docs/papers/) / [English](https://md.mova.elamur.ai/free/en/docs/papers/en/) / A POS Tagging Model Designed for Learner English

# A POS Tagging Model Designed for Learner English

**Authors:** [Ryo Nagata](https://md.mova.elamur.ai/free/en/docs/papers/authors/ryo-nagata/), [Tomoya Mizumoto](https://md.mova.elamur.ai/free/en/docs/papers/authors/tomoya-mizumoto/), Yuta Kikuchi, Yoshifumi Kawasaki and Kotaro Funakoshi · **Year:** 2018 · **Venue:** Proceedings of the 2018 EMNLP Workshop W-NUT: The 4th Workshop on Noisy User-generated Text, pages 39–48 **Link:** [aclanthology.org/W18-6106](https://aclanthology.org/W18-6106/) · **Licence:** [CC BY 4.0](https://creativecommons.org/licenses/by/4.0/) (ACL Anthology)

[**9** citations](https://openalex.org/works?filter=cites:W2911926960) openalex · 2026-10-18[**2** citations in our library](https://md.mova.elamur.ai/free/en/docs/papers/cited-by/nagata-2018-pos-tagging-model-adapted-learner/) of the 140673 papers whose bibliographies we read[Proceedings of the 2018 EMNLP Workshop W-NUT: The 4th Workshop on Noisy User-generated Text](https://aclanthology.org/volumes/W18-61/)[licence](https://creativecommons.org/licenses/by/4.0/)

- [Publisher's page](https://aclanthology.org/W18-6106/)
- [PDF](https://aclanthology.org/W18-6106.pdf)
- [DOI 10.18653/v1/w18-6106](https://doi.org/10.18653/v1/w18-6106)
- [OpenAlex](https://openalex.org/W2911926960)

**Authors (5)**

1. [Ryo Nagata](https://openalex.org/A5068324214) [ORCID](https://orcid.org/0000-0002-5893-3335) · h 23 · 2441 citations · 125 works
2. [Tomoya Mizumoto](https://openalex.org/A5008935760) h 13 · 735 citations · 61 works
3. Yuta Kikuchi
4. [Yoshifumi Kawasaki](https://openalex.org/A5016903678) [ORCID](https://orcid.org/0000-0002-1100-474X) · h 4 · 44 citations · 15 works
5. [Kotaro Funakoshi](https://openalex.org/A5069989297) [ORCID](https://orcid.org/0000-0002-4529-4634) · h 19 · 1213 citations · 219 works

Citations and author metrics from openalex (2026-10-18); authors with the same name are not always told apart.

## What it is about

Taggers trained on edited English fail on learner English, and the authors trace the failures to unknown words (often misspellings), to capitalisation errors, to missing determiners, and to a different tag distribution (the word "like" is a preposition in 82% of the native corpus but a verb in 94% of the Konan-JIEM learner data). Their model is a bidirectional LSTM over word embeddings, character embeddings and a native-language vector, trained on Penn Treebank sections 00–18 and on learner text pre-trained without tags. It reaches 0.964 accuracy on the Treebank of Learner English test set, above the Turbo tagger's 0.958 with learner training data, and 0.948 on the Konan-JIEM corpus, where a CRF gets 0.940. The character module adds 1.0 point, and pre-training adds 0.3 to 0.6 points. For "like" the CRF reaches 0.635 on 304 instances and the model 0.927. The native-language module has almost no effect; the authors report this as a negative result.

## Ideas

- I1. `en/src/ptag.rs`: a count table of tags per word form in learner text, written as a BTreeMap, used as a prior only when the word's native-corpus and learner-corpus tag distributions differ strongly. Start with the "like" case and report it per word.
- I2. Character-level features for misspellings: a closed set of edit-distance-1 mappings (Becose to Because, thier to their) to the nearest lexicon form, stored as explicit rules with a reason string, so each recovered tag says which correction produced it.
- I3. Capitalisation rule: a sentence-initial bare noun with no determiner ("Flower is ...") is a candidate for a missing determiner, not a proper noun. Test it as a rule in `en/src/tag.rs` on the paper's examples and on held-out learner text.
- I4. The paper's native-language module is a negative result. Before any native-language table is built, run the ablation (module off, same data, same seeds) and report the difference, as the value-ablation practice requires.

## For Mova

The code points are `en/src/ptag.rs` (perceptron PTB tagger, where the word prior and character features would sit), `en/src/tok.rs` for tokens with capitals, and `en/src/tag.rs`. The chapters are [06. Spelling rules: inflection, derivation, compounds and national standards](https://md.mova.elamur.ai/free/en/docs/languages/en/06-spelling-rules/) and [10. Word classes](https://md.mova.elamur.ai/free/en/docs/languages/en/10-word-classes/). The measure: tag accuracy on a learner set Mova owns, split into the "like" cases and the rest, with the ablation of each rule run twice for determinism.

Topics: [Part-of-speech tagging](https://md.mova.elamur.ai/free/en/docs/papers/topics/part-of-speech-tagging/)

## Cite

The paper itself, not this card. BibTeX from the library's record of the work. [DOI 10.18653/v1/w18-6106](https://doi.org/10.18653/v1/w18-6106)

```
@inproceedings{nagata2018pos,
  title = {{A POS Tagging Model Designed for Learner English}},
  author = {Nagata, Ryo and Mizumoto, Tomoya and Kikuchi, Yuta and Kawasaki, Yoshifumi and Funakoshi, Kotaro},
  booktitle = {Proceedings of the 2018 EMNLP Workshop W-NUT: The 4th Workshop on Noisy User-generated Text},
  year = {2018},
  doi = {10.18653/v1/w18-6106},
  url = {https://doi.org/10.18653/v1/w18-6106}
}
```

- [← previous English Grammar, Adapted to the Different Classes of Learners, with an Appendix](https://md.mova.elamur.ai/free/en/docs/papers/murray-1795-english-grammar-adapted-different/)
- [next → Pragmatic information extraction from subject ellipsis in informal English](https://md.mova.elamur.ai/free/en/docs/papers/nariyama-2006-pragmatic-information-extraction-subject-ellipsis/)
- [↑ back to English](https://md.mova.elamur.ai/free/en/docs/papers/en/)

## References

1 references, 0 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Jan Aarts and Sylviane Granger. 1998. Tag sequences in learner corpora: a key to interlanguage grammar and discourse. Longman, New York. [find](https://scholar.google.com/scholar?q=Jan+Aarts+and+Sylviane+Granger%2E+1998%2E+Tag+sequences+in+learner+corpora%3A+a+key+to+interlanguage+grammar+and+discourse%2E+Longman%2C+New+York%2E)
