--- title: A chatbot is built on a "large language model": large because it is… — How a language model learns: guessing the next w… · tree and pragmatics description: A chatbot is built on a "large language model": large because it is enormous, language because it works with words, model because it is a copy of the patterns in how people write. Who acts: chatbot, people. A sentence of the lesson «How a language model learns: guessing the next word» of the ai cour --- [Mova](https://md.mova.elamur.ai/free/en/) · [this page in HTML](https://mova.elamur.ai/free/en/corpora/school/ai/2-guessing-the-next-word/0/) [home](https://md.mova.elamur.ai/free/en/) / [corpora](https://md.mova.elamur.ai/free/en/corpora/) / [school](https://md.mova.elamur.ai/free/en/corpora/school/) / [AI](https://md.mova.elamur.ai/free/en/corpora/school/ai/) / [How a language model learns: guessing…](https://md.mova.elamur.ai/free/en/corpora/school/ai/2-guessing-the-next-word/) / 0 # How a language model learns: guessing the next word, sentence 0 A chatbot is built on a "large language model": large because it is enormous, language because it works with words, model because it is a copy of the patterns in how people write. **Who acts:** chatbot, people · **What happens:** build, be, work, write · **To what, where:** chatbot, large enormous language, copy This is a sentence of the lesson «How a language model learns: guessing the next word» of the ai course of Mova's primary school. The page gives its syntax tree — a dependency tree in the style of Universal Dependencies — and its pragmatics clause by clause: who acts (chatbot, people), what happens, when and where, as Mova's frames read it from the tree. ## The tree {#tree} ```conllu # sent_id = school:ai:002-guessing-the-next-word.lesson:0 # text = A chatbot is built on a "large language model": large because it is enormous, language because it works with words, model because it is a copy of the patterns in how people write. # source = school lesson (ours) # course = ai # lesson = 002-guessing-the-next-word.lesson # annotation = Mova annot: Rust (en) → Haiku 5.5 (medium, Batches API) patches; gates UD 2.18; agreed by treeagree rules (Stanza, Trankit, spaCy trf): R6-punct-agree ×1 1 A a DET DT Definite=Ind|PronType=Art 2 det _ _ 2 chatbot chatbot NOUN NN Number=Sing 4 nsubj:pass _ _ 3 is be AUX VBZ Mood=Ind|Number=Sing|Person=3|Tense=Pres|VerbForm=Fin 4 aux:pass _ _ 4 built build VERB VBN Tense=Past|VerbForm=Part|Voice=Pass 0 root _ _ 5 on on ADP IN _ 10 case _ _ 6 a a DET DT Definite=Ind|PronType=Art 10 det _ _ 7 " " PUNCT `` _ 10 punct _ _ 8 large large ADJ JJ Degree=Pos 10 amod _ _ 9 language language NOUN NN Number=Sing 10 compound _ _ 10 model model NOUN NN Number=Sing 4 obl _ _ 11 " " PUNCT '' _ 10 punct _ _ 12 : : PUNCT : _ 19 punct _ _ 13 large large ADJ JJ Degree=Pos 19 amod _ _ 14 because because SCONJ IN _ 17 mark _ _ 15 it it PRON PRP Case=Nom|Gender=Neut|Number=Sing|Person=3|PronType=Prs 17 nsubj _ _ 16 is be AUX VBZ Mood=Ind|Number=Sing|Person=3|Tense=Pres|VerbForm=Fin 17 cop _ _ 17 enormous enormous ADJ JJ Degree=Pos 19 amod _ _ 18 , , PUNCT , _ 19 punct _ Agree=R6-punct-agree|Haiku=17:punct 19 language language NOUN NN Number=Sing 10 appos _ _ 20 because because SCONJ IN _ 22 mark _ _ 21 it it PRON PRP Case=Nom|Gender=Neut|Number=Sing|Person=3|PronType=Prs 22 nsubj _ _ 22 works work VERB VBZ Mood=Ind|Number=Sing|Person=3|Tense=Pres|VerbForm=Fin 19 acl:relcl _ _ 23 with with ADP IN _ 24 case _ _ 24 words word NOUN NNS Number=Plur 22 obl _ _ 25 , , PUNCT , _ 26 punct _ _ 26 model model NOUN NN Number=Sing 24 appos _ _ 27 because because SCONJ IN _ 31 mark _ _ 28 it it PRON PRP Case=Nom|Gender=Neut|Number=Sing|Person=3|PronType=Prs 31 nsubj _ _ 29 is be AUX VBZ Mood=Ind|Number=Sing|Person=3|Tense=Pres|VerbForm=Fin 31 cop _ _ 30 a a DET DT Definite=Ind|PronType=Art 31 det _ _ 31 copy copy NOUN NN Number=Sing 4 ccomp _ _ 32 of of ADP IN _ 34 case _ _ 33 the the DET DT Definite=Def|PronType=Art 34 det _ _ 34 patterns pattern NOUN NNS Number=Plur 31 nmod _ _ 35 in in SCONJ IN _ 38 mark _ _ 36 how how ADV WRB PronType=Int 38 advmod _ _ 37 people people NOUN NNS Number=Plur 38 nsubj _ _ 38 write write VERB VBP Mood=Ind|Number=Plur|Person=3|Tense=Pres|VerbForm=Fin 4 advcl _ _ 39 . . PUNCT . _ 4 punct _ _ ``` ## Pragmatics {#pragmatics} - form: statement - act: assert - voice: narrator - polarity: none - teacher: changed act=assert | # | verb | tense, mood | who | what, whom | to whom | where | when | other | roles by | | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | | 1 | **build** | present · passive | | a chatbot | | | | on a large language model | vn base-97.1 «NP V NP PP.source»: subject=Theme on model=Source | | 2 | **is** | present | chatbot | | | | | enormous *property* | tree rules | | 3 | **work** | present | chatbot | large enormous language *not said here* | | | | with words | vn knead-26.5 «NP V NP.material»: agent=Agent language=Material | | 4 | **is a** | present | chatbot | a copy | | | | of the patterns | tree rules | | 5 | **write** | present | people | | | | | | vn scribble-25.2-1 «NP V»: agent=Agent | One row per clause the reader finds. «not said here»: a role filled from the clause above. «roles by»: a VerbNet class and frame when one fits the verb, else the reader's rules on the tree. **Licence: [CC BY-SA 4.0](https://creativecommons.org/licenses/by-sa/4.0/)**, as the whole of Mova corpus 0.4, of which this treebank (the agreed school, `mova-school-agreed-en.conllu`) is part. The lessons were written for Mova's primary school. Sentence `school:ai:002-guessing-the-next-word.lesson:0`. **The tree:** Mova annot: Rust (en) → Haiku 5.5 (medium, Batches API) patches; gates UD 2.18; agreed by treeagree rules (Stanza, Trankit, spaCy trf): R6-punct-agree ×1. **The frames** are read from the tree by Mova's frames reader (`prag`) when this page is built, the lesson read in order, so a pronoun may be resolved from an earlier sentence. See the [release 0.4](https://md.mova.elamur.ai/free/en/releases/0.4/). - ← previous: [What is AI? Pattern-guessers, not people, 16](https://md.mova.elamur.ai/free/en/corpora/school/ai/1-what-is-ai/16/) - next →: [How a language model learns: guessing…, 1](https://md.mova.elamur.ai/free/en/corpora/school/ai/2-guessing-the-next-word/1/) - ↑ back to [the lesson](https://md.mova.elamur.ai/free/en/corpora/school/ai/2-guessing-the-next-word/)