---
title: "my bot says it's 2023 lol, is it broken" What is likely going on? — How a language model learns: guessing… · tree and pragmatics
description: "my bot says it's 2023 lol, is it broken" What is likely going on? Test 1 of lesson 2 «How a language model learns: guessing the next word» of the AI course of Mova's primary school, with the dependency tree and pragmatics of the question and of each option; Mova's choice was right.
---

<!-- md -->
[Mova](https://md.mova.elamur.ai/free/en/) · [this page in HTML](https://mova.elamur.ai/free/en/corpora/questions/ai/2-guessing-the-next-word/t1/)

<!-- crumbs -->
[home](https://md.mova.elamur.ai/free/en/) / [corpora](https://md.mova.elamur.ai/free/en/corpora/) / [questions](https://md.mova.elamur.ai/free/en/corpora/questions/) / [AI](https://md.mova.elamur.ai/free/en/corpora/questions/ai/) / [How a language model learns: guessing…](https://md.mova.elamur.ai/free/en/corpora/questions/ai/2-guessing-the-next-word/) / t1

# Test 1 · How a language model learns: guessing the next word

<!-- .ven lang=en -->
"my bot says it's 2023 lol, is it broken" What is likely going on?

<!-- .vintro -->
**Mova's choice:** option 3 · **The right answer:** option 3 · right ✓ · **Who acts:** bot · **What happens:** say, be, break, go on · **To what, where:** 2023, bot · **Speech:** someone speaks here

<!-- .vabout -->
This is test 1 of lesson 2 «How a language model learns: guessing the next word» of the AI course of Mova's primary school. The page gives the question's syntax tree — a dependency tree in the style of Universal Dependencies — and its pragmatics clause by clause, then the 4 options as the student saw them, each with its tree and pragmatics. Every text is parsed by Mova itself. How the student answered it, with the score of every option and why: [the test at school](https://md.mova.elamur.ai/free/en/school-run/ai/2-guessing-the-next-word/#t1).

## The question {#question}

```conllu
# sent_id = question:ai:2-guessing-the-next-word:t1:1
# text = "my bot says it's 2023 lol, is it broken" What is likely going on?
1	"	"	PUNCT	``	_	4	punct	_	SpaceAfter=No
2	my	my	PRON	PRP$	Case=Gen|Number=Sing|Person=1|Poss=Yes|PronType=Prs	3	nmod:poss	_	_
3	bot	bot	NOUN	NN	Number=Sing	4	nsubj	_	_
4	says	say	VERB	VBZ	Mood=Ind|Number=Sing|Person=3|Tense=Pres|VerbForm=Fin	0	root	_	_
5	it	it	PRON	PRP	Case=Nom|Gender=Neut|Number=Sing|Person=3|PronType=Prs	7	nsubj	_	SpaceAfter=No
6	's	be	AUX	VBZ	Mood=Ind|Number=Sing|Person=3|Tense=Pres|VerbForm=Fin	7	cop	_	_
7	2023	2023	NUM	CD	NumForm=Digit|NumType=Card	4	obl	_	_
8	lol	lol	INTJ	UH	_	7	discourse	_	SpaceAfter=No
9	,	,	PUNCT	,	_	12	punct	_	_
10	is	be	AUX	VBZ	Mood=Ind|Number=Sing|Person=3|Tense=Pres|VerbForm=Fin	12	aux:pass	_	_
11	it	it	PRON	PRP	Case=Nom|Gender=Neut|Number=Sing|Person=3|PronType=Prs	12	nsubj:pass	_	_
12	broken	break	VERB	VBN	Tense=Past|VerbForm=Part|Voice=Pass	4	conj	_	SpaceAfter=No
13	"	"	PUNCT	``	_	16	punct	_	_
14	What	what	PRON	WP	PronType=Int	16	nsubj	_	_
15	is	be	AUX	VBZ	Mood=Ind|Number=Sing|Person=3|Tense=Pres|VerbForm=Fin	16	cop	_	_
16	likely	likely	ADJ	JJ	Degree=Pos	12	conj	_	_
17	going	go	VERB	VBG	VerbForm=Ger	16	ccomp	_	_
18	on	on	ADP	RP	_	17	compound:prt	_	SpaceAfter=No
19	?	?	PUNCT	.	_	4	punct	_	_
```

<!-- .fr -->
| # | verb | tense, mood | who | what, whom | to whom | where | when | other | roles by |
| --- | --- | --- | --- | --- | --- | --- | --- | --- | --- |
| 1 | **say** *speech: assert* *in a quote* | present | my bot |  |  |  |  |  | vn say-37.7-1-1 «NP V that S»: agent=Agent |
| 2 | **is a** *in a quote* | present | bot | 2023 |  |  |  |  | tree rules |
| 3 | **break** *in a quote* | present · passive |  | bot |  |  |  |  | vn hurt-40.8.3-1-1 «NP V NP»: subject=Patient |
| 4 | **is** | present |  |  |  |  |  | likely *property* | tree rules |
| 5 | **go on** | gerund |  |  |  |  |  |  | vn function-105.2.1 «NP V»: agent=Theme |

<!-- .note -->
One row per clause the reader finds. «not said here»: a role filled from the clause above. «roles by»: a VerbNet class and frame when one fits the verb, else the reader's rules on the tree.

## The options {#options}

### Option 1 {#o1}

<!-- .ven lang=en -->
It lives in a different time zone from you

```conllu
# sent_id = question:ai:2-guessing-the-next-word:t1:o1:1
# text = It lives in a different time zone from you
1	It	it	PRON	PRP	Case=Nom|Gender=Neut|Number=Sing|Person=3|PronType=Prs	2	nsubj	_	_
2	lives	live	VERB	VBZ	Mood=Ind|Number=Sing|Person=3|Tense=Pres|VerbForm=Fin	0	root	_	_
3	in	in	ADP	IN	_	7	case	_	_
4	a	a	DET	DT	Definite=Ind|PronType=Art	7	det	_	_
5	different	different	ADJ	JJ	Degree=Pos	7	amod	_	_
6	time	time	NOUN	NN	Number=Sing	7	compound	_	_
7	zone	zone	NOUN	NN	Number=Sing	2	obl	_	_
8	from	from	ADP	IN	_	9	case	_	_
9	you	you	PRON	PRP	Case=Acc|Person=2|PronType=Prs	2	obl	_	_
```

<!-- .fr -->
| # | verb | tense, mood | who | what, whom | to whom | where | when | other | roles by |
| --- | --- | --- | --- | --- | --- | --- | --- | --- | --- |
| 1 | **live** | present | It |  |  | a different time zone |  | from you | vn lodge-46 «NP V PP.location»: agent=Theme in zone=Location |

### Option 2 {#o2}

<!-- .ven lang=en -->
It is broken inside and must be thrown away and replaced with a new one

<!-- fold The tree, 15 words -->
```conllu
# sent_id = question:ai:2-guessing-the-next-word:t1:o2:1
# text = It is broken inside and must be thrown away and replaced with a new one
1	It	it	PRON	PRP	Case=Nom|Gender=Neut|Number=Sing|Person=3|PronType=Prs	3	nsubj:pass	_	_
2	is	be	AUX	VBZ	Mood=Ind|Number=Sing|Person=3|Tense=Pres|VerbForm=Fin	3	aux:pass	_	_
3	broken	break	VERB	VBN	Tense=Past|VerbForm=Part|Voice=Pass	0	root	_	_
4	inside	inside	ADV	RB	_	3	advmod	_	_
5	and	and	CCONJ	CC	_	8	cc	_	_
6	must	must	AUX	MD	VerbForm=Fin	8	aux	_	_
7	be	be	AUX	VB	VerbForm=Inf	8	aux:pass	_	_
8	thrown	throw	VERB	VBN	Tense=Past|VerbForm=Part|Voice=Pass	3	conj	_	_
9	away	away	ADV	RB	_	8	advmod	_	_
10	and	and	CCONJ	CC	_	11	cc	_	_
11	replaced	replace	VERB	VBN	Tense=Past|VerbForm=Part|Voice=Pass	8	conj	_	_
12	with	with	ADP	IN	_	15	case	_	_
13	a	a	DET	DT	Definite=Ind|PronType=Art	15	det	_	_
14	new	new	ADJ	JJ	Degree=Pos	15	amod	_	_
15	one	one	NOUN	NN	Number=Sing	11	obl	_	_
```

<!-- .fr -->
| # | verb | tense, mood | who | what, whom | to whom | where | when | other | roles by |
| --- | --- | --- | --- | --- | --- | --- | --- | --- | --- |
| 1 | **break** | present · passive |  | It |  |  |  | inside *property* | vn hurt-40.8.3-1-1 «NP V NP»: subject=Patient |
| 2 | **throw away** | must · passive |  |  |  |  |  | away *property* | vn amuse-31.1 «NP V ADV-Middle» |
| 3 | **replace** | participle |  |  |  |  |  | with a new one | vn substitute-13.6.2-1 «NP V NP PP.co-theme»: agent=Theme with one=Co-Theme |

### Option 3 · ← Mova's choice · ✓ the right answer {#o3}

<!-- .ven lang=en -->
Its training text ended long ago and it has no clock

```conllu
# sent_id = question:ai:2-guessing-the-next-word:t1:o3:1
# text = Its training text ended long ago and it has no clock
1	Its	its	PRON	PRP$	Case=Gen|Gender=Neut|Number=Sing|Person=3|Poss=Yes|PronType=Prs	3	nmod:poss	_	_
2	training	training	NOUN	NN	Number=Sing	3	compound	_	_
3	text	text	NOUN	NN	Number=Sing	4	nsubj	_	_
4	ended	end	VERB	VBD	Mood=Ind|Number=Sing|Person=3|Tense=Past|VerbForm=Fin	0	root	_	_
5	long	long	ADV	RB	Degree=Pos	6	advmod	_	_
6	ago	ago	ADV	RB	_	4	advmod	_	_
7	and	and	CCONJ	CC	_	9	cc	_	_
8	it	it	PRON	PRP	Case=Nom|Gender=Neut|Number=Sing|Person=3|PronType=Prs	9	nsubj	_	_
9	has	have	VERB	VBZ	Mood=Ind|Number=Sing|Person=3|Tense=Pres|VerbForm=Fin	4	conj	_	_
10	no	no	DET	DT	PronType=Neg	11	det	_	_
11	clock	clock	NOUN	NN	Number=Sing	9	obj	_	_
```

<!-- .fr -->
| # | verb | tense, mood | who | what, whom | to whom | where | when | other | roles by |
| --- | --- | --- | --- | --- | --- | --- | --- | --- | --- |
| 1 | **end** | past | Its training text |  |  |  |  | ago *property* | vn stop-55.4-1-1 «NP.eventuality V»: agent=Eventuality |
| 2 | **have** | present | text | no clock |  |  |  |  | vn birth-28.2-1 «NP V NP»: agent=Agent clock=Patient |

### Option 4 {#o4}

<!-- .ven lang=en -->
It is joking because it is bored

```conllu
# sent_id = question:ai:2-guessing-the-next-word:t1:o4:1
# text = It is joking because it is bored
1	It	it	PRON	PRP	Case=Nom|Gender=Neut|Number=Sing|Person=3|PronType=Prs	3	nsubj	_	_
2	is	be	AUX	VBZ	Mood=Ind|Number=Sing|Person=3|Tense=Pres|VerbForm=Fin	3	aux	_	_
3	joking	joke	VERB	VBG	Tense=Pres|VerbForm=Part	0	root	_	_
4	because	because	SCONJ	IN	_	7	mark	_	_
5	it	it	PRON	PRP	Case=Nom|Gender=Neut|Number=Sing|Person=3|PronType=Prs	7	nsubj	_	_
6	is	be	AUX	VBZ	Mood=Ind|Number=Sing|Person=3|Tense=Pres|VerbForm=Fin	7	cop	_	_
7	bored	bored	ADJ	JJ	Degree=Pos	3	advcl	_	_
```

<!-- .fr -->
| # | verb | tense, mood | who | what, whom | to whom | where | when | other | roles by |
| --- | --- | --- | --- | --- | --- | --- | --- | --- | --- |
| 1 | **joke** *speech: other* | present · progressive | It |  |  |  |  |  | vn chit\_chat-37.6 «NP V»: agent=Agent |
| 2 | **is** | present | it |  |  |  |  | bored *property* | tree rules |

<!-- div src -->

**Text:** the tests of Mova's primary school, written for Mova (`world/data/school/`), as the course runner gave them to the student. **Trees:** Mova's own parse — the `en` model on the CPU, when the site is built — not checked by a teacher; they may be wrong. **Frames:** Mova's frames reader (`prag`), each text read on its own. Elamur Cosmic License.

<!-- /div -->

<!-- pn -->
- ← previous: [What is AI? Pattern-guessers, not people, exam 4](https://md.mova.elamur.ai/free/en/corpora/questions/ai/1-what-is-ai/e4/)
- next →: [How a language model learns: guessing…, test 2](https://md.mova.elamur.ai/free/en/corpora/questions/ai/2-guessing-the-next-word/t2/)
- ↑ back to [How a language model learns: guessing the next word](https://md.mova.elamur.ai/free/en/corpora/questions/ai/2-guessing-the-next-word/)