[Mova](https://md.mova.elamur.ai/free/en/) · [this page in HTML](https://mova.elamur.ai/free/en/docs/papers/paul-2019-towards-universal-dialogue-act-tagging/)

[home](https://md.mova.elamur.ai/free/en/) / [docs](https://md.mova.elamur.ai/free/en/docs/) / [papers](https://md.mova.elamur.ai/free/en/docs/papers/) / [English](https://md.mova.elamur.ai/free/en/docs/papers/en/) / Towards Universal Dialogue Act Tagging for Task-Oriented Dialogues

# Towards Universal Dialogue Act Tagging for Task-Oriented Dialogues

**Authors:** Shachi Paul, Rahul Goel, Dilek Hakkani-Tür · **Year:** 2019 · **Venue:** Interspeech 2019 (arXiv:1907.03020) **Link:** [arxiv.org/abs/1907.03020](https://arxiv.org/abs/1907.03020) · **Licence:** [CC BY 4.0](https://creativecommons.org/licenses/by/4.0/)

[**8** citations in our library](https://md.mova.elamur.ai/free/en/docs/papers/cited-by/paul-2019-towards-universal-dialogue-act-tagging/) of the 140673 papers whose bibliographies we readarXiv:1907.03020[licence](http://creativecommons.org/licenses/by/4.0/)

- [Publisher's page](https://arxiv.org/abs/1907.03020)
- [PDF](https://arxiv.org/pdf/1907.03020)
- [arXiv 1907.03020](https://arxiv.org/abs/1907.03020)

**Authors (3)**

1. Shachi Paul
2. Rahul Goel
3. Dilek Hakkani-Tur

Citations and author metrics from OpenAlex (); authors with the same name are not always told apart.

## What it is about

Task-oriented dialogue corpora (Google simulated dialogues for movies and restaurants, DSTC2, MultiWOZ 2.0) each use their own act names, and even shared names mean different things. The authors align them into one «universal» schema of 20 system and user acts, first by hand, then by merging or splitting acts that confused the tagger but can be restored from other information (offer/select merged, user/system request merged, «affirm with a value» split into affirm + inform, «anything else?» variants merged). Each step is measured: cross-dataset F1 rises from 0.44 to 0.56 while within-dataset F1 stays about 0.90. A hierarchical LSTM tagger trained on the aligned human-machine data reaches 0.54 F1 on human-human MultiWOZ turns; self-training on unlabelled MultiWOZ raises it to 0.58, which would otherwise take about 1,700 hand-labelled turns. Keyword rules (*bye*, *thank you*) were needed to repair MultiWOZ's own inconsistent labels.

## Ideas

- I1. Merge in the model, split by rule: when two labels differ by something a deterministic rule can restore, train the classifier on the merged label and restore the split afterwards. For Mova the clearest case is `narrate`/`assert`: the teacher changed 13,316 labels to narrate and 23,371 to assert, and the border is largely voice, tense and genre, which `prag` already sees. Train on a merged «inform» and restore with a rule (narrator voice + past event frame → narrate); compare act macro-F1 and agreement with the teacher against the current 16-way model.
- I2. Measure each label merge or split the way the paper does, one step at a time, with cross-genre and within-genre scores side by side (tales vs Tatoeba vs lessons in `prag eval`), so a change that helps one genre and hurts another is seen.
- I3. Self-training on unlabelled in-domain sentences, but only those where the perceptron, IGTree and k-NN agree (84.5% accurate on act), as cheap extra training data for a new genre (lessons). Measure on the held-out silver of that genre, with the agreement audit from [prag — Mova pragmatics: LLM silver and a transparent SLM](https://md.mova.elamur.ai/free/en/docs/prag/) (a random sample of agreed sentences to the teacher) as the guard against learning shared errors.

## For Mova

[31. Speech acts](https://md.mova.elamur.ai/free/en/docs/languages/en/31-speech-acts/) §7.3 (Mova's acts against the schemes) and §9 (how Mova labels acts; the assert/narrate border). Code: `prag/src/schema.rs`, `prag/src/agree.rs` (restoring rules), `prag/src/model.rs`, `prag/src/eval.rs`. Measures: act macro-F1 per genre, agreement with teacher labels, gain from self-training on a held-out genre.

Topics: [Speech act theory](https://md.mova.elamur.ai/free/en/docs/papers/topics/speech-act-theory/)

## Cite

The paper itself, not this card. BibTeX from the library's record of the work. [arXiv 1907.03020](https://arxiv.org/abs/1907.03020)

```
@misc{paul2019universal,
  title = {{Towards Universal Dialogue Act Tagging for Task-Oriented Dialogues}},
  author = {Paul, Shachi and Goel, Rahul and Hakkani-Tur, Dilek},
  year = {2019},
  eprint = {1907.03020},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/1907.03020}
}
```

- [← previous CoNLL-X Shared Task on Multilingual Dependency Parsing](https://md.mova.elamur.ai/free/en/docs/papers/parsers-2006-buchholz-conll-x-shared-task-multilingual/)
- [next → Scoring Coreference Chains with Split-Antecedent Anaphors](https://md.mova.elamur.ai/free/en/docs/papers/paun-2023-scoring-coreference-chains-split-antecedent/)
- [↑ back to English](https://md.mova.elamur.ai/free/en/docs/papers/en/)

## References

25 references, 2 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. J. L. Austin, How to do things with words. press, 1975. Oxford university [find](https://scholar.google.com/scholar?q=J%2E+L%2E+Austin%2C+How+to+do+things+with+words%2E+press%2C+1975%2E+Oxford+university)
2. A. Stolcke, K. Ries, N. Coccaro, E. Shriberg, R. Bates, D. Jurafsky, P. Taylor, R. Martin, C. V. Ess-Dykema, and M. Meteer, “Dialogue act modeling for automatic tagging and recognition of conversational speech,” Computational linguistics, vol. 26, no. 3, pp. 339–373, 2000. [find](https://scholar.google.com/scholar?q=A%2E+Stolcke%2C+K%2E+Ries%2C+N%2E+Coccaro%2C+E%2E+Shriberg%2C+R%2E+Bates%2C+D%2E+Jurafsky%2C+P%2E+Taylor%2C+R%2E+Martin%2C+C%2E+V%2E+Ess%2DDykema%2C+and+M%2E+Meteer%2C+%E2%80%9CDialogue+act+modeling+for+automatic+tagging+and+recognition+of+conversation) [our card](https://md.mova.elamur.ai/free/en/docs/papers/prag-2000-stolcke-dialogue-act-modeling-automatic-tagging/)
3. A. H. Anderson, M. Bader, E. G. Bard, E. Boyle, G. Doherty, S. Garrod, S. Isard, J. Kowtko, J. McAllister, J. Miller et al., “The hcrc map task corpus,” Language and speech, vol. 34, no. 4, pp. 351–366, 1991. [find](https://scholar.google.com/scholar?q=A%2E+H%2E+Anderson%2C+M%2E+Bader%2C+E%2E+G%2E+Bard%2C+E%2E+Boyle%2C+G%2E+Doherty%2C+S%2E+Garrod%2C+S%2E+Isard%2C+J%2E+Kowtko%2C+J%2E+McAllister%2C+J%2E+Miller+et+al%2E%2C+%E2%80%9CThe+hcrc+map+task+corpus%2C%E2%80%9D+Language+and+speech%2C+vol%2E+34%2C+no%2E+4%2C+pp%2E+351%E2%80%9336)
4. M. G. Core and J. Allen, “Coding dialogs with the damsl annotation scheme,” in AAAI fall symposium on communicative action in humans and machines, vol. 56. Boston, MA, 1997. [find](https://scholar.google.com/scholar?q=M%2E+G%2E+Core+and+J%2E+Allen%2C+%E2%80%9CCoding+dialogs+with+the+damsl+annotation+scheme%2C%E2%80%9D+in+AAAI+fall+symposium+on+communicative+action+in+humans+and+machines%2C+vol%2E+56%2E+Boston%2C+MA%2C+1997%2E)
5. H. Bunt, “The dit++ taxonomy for functional dialogue markup,” in AAMAS 2009 Workshop, Towards a Standard Markup Language for Embodied Dialogue Acts, 2009, pp. 13–24. [find](https://scholar.google.com/scholar?q=H%2E+Bunt%2C+%E2%80%9CThe+dit%2B%2B+taxonomy+for+functional+dialogue+markup%2C%E2%80%9D+in+AAMAS+2009+Workshop%2C+Towards+a+Standard+Markup+Language+for+Embodied+Dialogue+Acts%2C+2009%2C+pp%2E+13%E2%80%9324%2E)
6. S. Mezza, A. Cervone, G. Tortoreto, E. A. Stepanov, and G. Riccardi, “Iso-standard domain-independent dialogue act tagging for conversational agents,” arXiv preprint arXiv:1806.04327, 2018. [↗](https://arxiv.org/abs/1806.04327) [our card](https://md.mova.elamur.ai/free/en/docs/papers/mezza-2018-iso-standard-domain-independent-dialogue/)
7. S. Young, “Cued standard dialogue acts,” Report, Cambridge University Engineering Department, 14th October, vol. 2007, 2007. [find](https://scholar.google.com/scholar?q=S%2E+Young%2C+%E2%80%9CCued+standard+dialogue+acts%2C%E2%80%9D+Report%2C+Cambridge+University+Engineering+Department%2C+14th+October%2C+vol%2E+2007%2C+2007%2E)
8. H. Bunt, J. Alexandersson, J. Carletta, J.-W. Choe, A. C. Fang, K. Hasida, K. Lee, V. Petukhova, A. Popescu-Belis, L. Romary et al., “Towards an iso standard for dialogue act annotation,” in Seventh conference on International Language Resources and Evaluation (LREC’10), 2010. [find](https://scholar.google.com/scholar?q=H%2E+Bunt%2C+J%2E+Alexandersson%2C+J%2E+Carletta%2C+J%2E%2DW%2E+Choe%2C+A%2E+C%2E+Fang%2C+K%2E+Hasida%2C+K%2E+Lee%2C+V%2E+Petukhova%2C+A%2E+Popescu%2DBelis%2C+L%2E+Romary+et+al%2E%2C+%E2%80%9CTowards+an+iso+standard+for+dialogue+act+annotation%2C%E2%80%9D+in+Seventh+c)
9. P. Shah, D. Hakkani-Tür, B. Liu, and G. Tur, “Bootstrapping a neural conversational agent with dialogue self-play, crowdsourcing and on-line reinforcement learning,” in Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL/HLT), vol. 3, 2018, pp. 41–51. [find](https://scholar.google.com/scholar?q=P%2E+Shah%2C+D%2E+Hakkani%2DTu%CC%88r%2C+B%2E+Liu%2C+and+G%2E+Tur%2C+%E2%80%9CBootstrapping+a+neural+conversational+agent+with+dialogue+self%2Dplay%2C+crowdsourcing+and+on%2Dline+reinforcement+learning%2C%E2%80%9D+in+Proceedings+of+the+2018+Confer)
10. M. Gašić, F. Lefevre, F. Jurčı́ček, S. Keizer, F. Mairesse, B. Thomson, K. Yu, and S. Young, “Back-off action selection in summary space-based pomdp dialogue systems,” in IEEE Workshop on Automatic Speech Recognition & Understanding. IEEE, 2009, pp. 456–461. [find](https://scholar.google.com/scholar?q=M%2E+Gas%CC%8Cic%CC%81%2C+F%2E+Lefevre%2C+F%2E+Jurc%CC%8C%C4%B1%CC%81c%CC%8Cek%2C+S%2E+Keizer%2C+F%2E+Mairesse%2C+B%2E+Thomson%2C+K%2E+Yu%2C+and+S%2E+Young%2C+%E2%80%9CBack%2Doff+action+selection+in+summary+space%2Dbased+pomdp+dialogue+systems%2C%E2%80%9D+in+IEEE+Workshop+on+Automati)
11. J. D. Williams, K. Asadi, and G. Zweig, “Hybrid code networks: practical and efficient end-to-end dialog control with supervised and reinforcement learning,” in 55th Annual Meeting of the Association for Computational Linguistics (ACL), 2017. [find](https://scholar.google.com/scholar?q=J%2E+D%2E+Williams%2C+K%2E+Asadi%2C+and+G%2E+Zweig%2C+%E2%80%9CHybrid+code+networks%3A+practical+and+efficient+end%2Dto%2Dend+dialog+control+with+supervised+and+reinforcement+learning%2C%E2%80%9D+in+55th+Annual+Meeting+of+the+Association+)
12. B. Liu, G. Tur, D. Hakkani-Tür, P. Shah, and L. Heck, “Dialogue learning with human teaching and feedback in end-to-end trainable task-oriented dialogue systems,” in Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL/HLT), 2018. [find](https://scholar.google.com/scholar?q=B%2E+Liu%2C+G%2E+Tur%2C+D%2E+Hakkani%2DTu%CC%88r%2C+P%2E+Shah%2C+and+L%2E+Heck%2C+%E2%80%9CDialogue+learning+with+human+teaching+and+feedback+in+end%2Dto%2Dend+trainable+task%2Doriented+dialogue+systems%2C%E2%80%9D+in+Proceedings+of+the+2018+Conferenc)
13. P. Budzianowski, T.-H. Wen, B.-H. Tseng, I. Casanueva, S. Ultes, . O. Ramadan, and M. Gašić, “Multiwoz-a large-scale multi-domain wizard-of-oz dataset for task-oriented dialogue modelling,” arXiv preprint arXiv:1810.00278, 2018. [↗](https://arxiv.org/abs/1810.00278)
14. B. Krause, M. Damonte, M. Dobre, D. Duma, J. Fainberg, F. Fancellu, E. Kahembwe, J. Cheng, and B. Webber, “Edina: Building an open domain socialbot with self-dialogues,” Alexa Prize Proceedings, 2017. [find](https://scholar.google.com/scholar?q=B%2E+Krause%2C+M%2E+Damonte%2C+M%2E+Dobre%2C+D%2E+Duma%2C+J%2E+Fainberg%2C+F%2E+Fancellu%2C+E%2E+Kahembwe%2C+J%2E+Cheng%2C+and+B%2E+Webber%2C+%E2%80%9CEdina%3A+Building+an+open+domain+socialbot+with+self%2Ddialogues%2C%E2%80%9D+Alexa+Prize+Proceedings%2C+2017%2E)
15. J. J. Godfrey, E. C. Holliman, and J. McDaniel, “Switchboard: Telephone speech corpus for research and development,” in icassp. IEEE, 1992, pp. 517–520. [find](https://scholar.google.com/scholar?q=J%2E+J%2E+Godfrey%2C+E%2E+C%2E+Holliman%2C+and+J%2E+McDaniel%2C+%E2%80%9CSwitchboard%3A+Telephone+speech+corpus+for+research+and+development%2C%E2%80%9D+in+icassp%2E+IEEE%2C+1992%2C+pp%2E+517%E2%80%93520%2E)
16. M. Henderson, B. Thomson, and J. D. Williams, “The second dialog state tracking challenge,” in Proceedings of the 15th Annual Meeting of the Special Interest Group on Discourse and Dialogue (SIGDIAL), 2014, pp. 263–272. [find](https://scholar.google.com/scholar?q=M%2E+Henderson%2C+B%2E+Thomson%2C+and+J%2E+D%2E+Williams%2C+%E2%80%9CThe+second+dialog+state+tracking+challenge%2C%E2%80%9D+in+Proceedings+of+the+15th+Annual+Meeting+of+the+Special+Interest+Group+on+Discourse+and+Dialogue+%28SIGDIAL%29%2C)
17. H. Bunt, “The semantics of dialogue acts,” in Proceedings of the Ninth International Conference on Computational Semantics. Association for Computational Linguistics, 2011, pp. 1–13. [find](https://scholar.google.com/scholar?q=H%2E+Bunt%2C+%E2%80%9CThe+semantics+of+dialogue+acts%2C%E2%80%9D+in+Proceedings+of+the+Ninth+International+Conference+on+Computational+Semantics%2E+Association+for+Computational+Linguistics%2C+2011%2C+pp%2E+1%E2%80%9313%2E)
18. J. Ang, Y. Liu, and E. Shriberg, “Automatic dialog act segmentation and classification in multiparty meetings,” in Proceedings.(ICASSP’05). IEEE International Conference on Acoustics, Speech, and Signal Processing, 2005., vol. 1. IEEE, 2005, pp. I–1061. [find](https://scholar.google.com/scholar?q=J%2E+Ang%2C+Y%2E+Liu%2C+and+E%2E+Shriberg%2C+%E2%80%9CAutomatic+dialog+act+segmentation+and+classification+in+multiparty+meetings%2C%E2%80%9D+in+Proceedings%2E%28ICASSP%E2%80%9905%29%2E+IEEE+International+Conference+on+Acoustics%2C+Speech%2C+and+Sign)
19. M. Zimmermann, “Joint segmentation and classification of dialog acts using conditional random fields,” in Tenth Annual Conference of the International Speech Communication Association, 2009. [find](https://scholar.google.com/scholar?q=M%2E+Zimmermann%2C+%E2%80%9CJoint+segmentation+and+classification+of+dialog+acts+using+conditional+random+fields%2C%E2%80%9D+in+Tenth+Annual+Conference+of+the+International+Speech+Communication+Association%2C+2009%2E)
20. G. Ji and J. Bilmes, “Dialog act tagging using graphical models,” in Proceedings.(ICASSP’05). IEEE International Conference on Acoustics, Speech, and Signal Processing, 2005., vol. 1. IEEE, 2005, pp. I–33. [find](https://scholar.google.com/scholar?q=G%2E+Ji+and+J%2E+Bilmes%2C+%E2%80%9CDialog+act+tagging+using+graphical+models%2C%E2%80%9D+in+Proceedings%2E%28ICASSP%E2%80%9905%29%2E+IEEE+International+Conference+on+Acoustics%2C+Speech%2C+and+Signal+Processing%2C+2005%2E%2C+vol%2E+1%2E+IEEE%2C+2005%2C+pp%2E+)
21. J. Y. Lee and F. Dernoncourt, “Sequential short-text classification with recurrent and convolutional neural networks,” arXiv preprint arXiv:1603.03827, 2016. [↗](https://arxiv.org/abs/1603.03827)
22. Y. Liu, K. Han, Z. Tan, and Y. Lei, “Using context information for dialog act classification in dnn framework,” in Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing, 2017, pp. 2170–2178. [find](https://scholar.google.com/scholar?q=Y%2E+Liu%2C+K%2E+Han%2C+Z%2E+Tan%2C+and+Y%2E+Lei%2C+%E2%80%9CUsing+context+information+for+dialog+act+classification+in+dnn+framework%2C%E2%80%9D+in+Proceedings+of+the+2017+Conference+on+Empirical+Methods+in+Natural+Language+Processin)
23. E. Shriberg, R. Dhillon, S. Bhagat, J. Ang, and H. Carvey, “The icsi meeting recorder dialog act (mrda) corpus,” in Proceedings of the 5th SIGdial Workshop on Discourse and Dialogue at HLT-NAACL 2004, 2004. [find](https://scholar.google.com/scholar?q=E%2E+Shriberg%2C+R%2E+Dhillon%2C+S%2E+Bhagat%2C+J%2E+Ang%2C+and+H%2E+Carvey%2C+%E2%80%9CThe+icsi+meeting+recorder+dialog+act+%28mrda%29+corpus%2C%E2%80%9D+in+Proceedings+of+the+5th+SIGdial+Workshop+on+Discourse+and+Dialogue+at+HLT%2DNAACL+2004%2C)
24. A. Margolis, K. Livescu, and M. Ostendorf, “Domain adaptation with unlabeled data for dialog act tagging,” in Proceedings of the 2010 Workshop on Domain Adaptation for Natural Language Processing. Association for Computational Linguistics, 2010, pp. 45–52. [find](https://scholar.google.com/scholar?q=A%2E+Margolis%2C+K%2E+Livescu%2C+and+M%2E+Ostendorf%2C+%E2%80%9CDomain+adaptation+with+unlabeled+data+for+dialog+act+tagging%2C%E2%80%9D+in+Proceedings+of+the+2010+Workshop+on+Domain+Adaptation+for+Natural+Language+Processing%2E+Ass)
25. P. Bojanowski, E. Grave, A. Joulin, and T. Mikolov, “Enriching word vectors with subword information,” Transactions of the Association for Computational Linguistics, vol. 5, pp. 135–146, 2017. [find](https://scholar.google.com/scholar?q=P%2E+Bojanowski%2C+E%2E+Grave%2C+A%2E+Joulin%2C+and+T%2E+Mikolov%2C+%E2%80%9CEnriching+word+vectors+with+subword+information%2C%E2%80%9D+Transactions+of+the+Association+for+Computational+Linguistics%2C+vol%2E+5%2C+pp%2E+135%E2%80%93146%2C+2017%2E)