---
title: Lily's bot was right about a fact, then switched when she typed "are… — Hallucinations: confident made-up answ… · tree and pragmatics
description: Lily's bot was right about a fact, then switched when she typed "are you sure?". What should she trust? Test 8 · ★ of lesson 5 «Hallucinations: confident made-up answers» of the AI course of Mova's primary school, with the dependency tree and pragmatics of the question and of each option; Mova's cho
---

<!-- md -->
[Mova](https://md.mova.elamur.ai/free/en/) · [this page in HTML](https://mova.elamur.ai/free/en/corpora/questions/ai/5-hallucinations-confident-made-up-answers/t8/)

<!-- crumbs -->
[home](https://md.mova.elamur.ai/free/en/) / [corpora](https://md.mova.elamur.ai/free/en/corpora/) / [questions](https://md.mova.elamur.ai/free/en/corpora/questions/) / [AI](https://md.mova.elamur.ai/free/en/corpora/questions/ai/) / [Hallucinations: confident made-up answ…](https://md.mova.elamur.ai/free/en/corpora/questions/ai/5-hallucinations-confident-made-up-answers/) / t8

# Test 8 · ★ · Hallucinations: confident made-up answers

<!-- .ven lang=en -->
Lily's bot was right about a fact, then switched when she typed "are you sure?". What should she trust?

<!-- .vintro -->
**Mova's choice:** option 1 · **The right answer:** option 4 · wrong ✗ · **Who acts:** bot, Lily, you · **What happens:** be, switch, type, trust

<!-- .vabout -->
This is test 8 · ★ of lesson 5 «Hallucinations: confident made-up answers» of the AI course of Mova's primary school. The page gives the question's syntax tree — a dependency tree in the style of Universal Dependencies — and its pragmatics clause by clause, then the 4 options as the student saw them, each with its tree and pragmatics. Every text is parsed by Mova itself. How the student answered it, with the score of every option and why: [the test at school](https://md.mova.elamur.ai/free/en/school-run/ai/5-hallucinations-confident-made-up-answers/#t8).

## The question {#question}

<!-- .note -->
*Sentence 1:* Lily's bot was right about a fact, then switched when she typed "are you sure?".

```conllu
# sent_id = question:ai:5-hallucinations-confident-made-up-answers:t8:1
# text = Lily's bot was right about a fact, then switched when she typed "are you sure?".
1	Lily	Lily	PROPN	NNP	Number=Sing	3	nmod:poss	_	SpaceAfter=No
2	's	's	PART	POS	_	1	case	_	_
3	bot	bot	NOUN	NN	Number=Sing	5	nsubj	_	_
4	was	be	AUX	VBD	Mood=Ind|Number=Sing|Person=3|Tense=Past|VerbForm=Fin	5	cop	_	_
5	right	right	ADJ	JJ	Degree=Pos	0	root	_	_
6	about	about	ADP	IN	_	8	case	_	_
7	a	a	DET	DT	Definite=Ind|PronType=Art	8	det	_	_
8	fact	fact	NOUN	NN	Number=Sing	5	obl	_	SpaceAfter=No
9	,	,	PUNCT	,	_	11	punct	_	_
10	then	then	ADV	RB	PronType=Dem	11	advmod	_	_
11	switched	switch	VERB	VBD	Mood=Ind|Number=Sing|Person=3|Tense=Past|VerbForm=Fin	5	parataxis	_	_
12	when	when	ADV	WRB	PronType=Int	14	advmod	_	_
13	she	she	PRON	PRP	Case=Nom|Gender=Fem|Number=Sing|Person=3|PronType=Prs	14	nsubj	_	_
14	typed	type	VERB	VBD	Mood=Ind|Number=Sing|Person=3|Tense=Past|VerbForm=Fin	18	advcl	_	_
15	"	"	PUNCT	''	_	14	punct	_	SpaceAfter=No
16	are	be	AUX	VBP	Mood=Ind|Number=Sing|Person=2|Tense=Pres|VerbForm=Fin	18	cop	_	_
17	you	you	PRON	PRP	Case=Nom|Person=2|PronType=Prs	18	nsubj	_	_
18	sure	sure	ADJ	JJ	Degree=Pos	11	conj	_	SpaceAfter=No
19	?	?	PUNCT	.	_	18	punct	_	SpaceAfter=No
20	"	"	PUNCT	''	_	18	punct	_	SpaceAfter=No
21	.	.	PUNCT	.	_	5	punct	_	_
```

<!-- .fr -->
| # | verb | tense, mood | who | what, whom | to whom | where | when | other | roles by |
| --- | --- | --- | --- | --- | --- | --- | --- | --- | --- |
| 1 | **is** | past | Lily's bot |  |  |  |  | about a fact; right *property* | tree rules |
| 2 | **switch** | past |  |  |  |  | then |  | vn convert-26.6.2-1-1 «NP V»: agent=Patient |
| 3 | **type** | past | Lily |  |  |  |  |  | vn scribble-25.2-1 «NP V»: agent=Agent |
| 4 | **is** *in a quote* | present | you |  |  |  |  | sure *property* | tree rules |

<!-- .note -->
One row per clause the reader finds. «not said here»: a role filled from the clause above. «roles by»: a VerbNet class and frame when one fits the verb, else the reader's rules on the tree.

<!-- .note -->
*Sentence 2:* What should she trust?

```conllu
# sent_id = question:ai:5-hallucinations-confident-made-up-answers:t8:2
# text = What should she trust?
1	What	what	PRON	WP	PronType=Int	4	obj	_	_
2	should	should	AUX	MD	VerbForm=Fin	4	aux	_	_
3	she	she	PRON	PRP	Case=Nom|Gender=Fem|Number=Sing|Person=3|PronType=Prs	4	nsubj	_	_
4	trust	trust	VERB	VB	VerbForm=Inf	0	root	_	SpaceAfter=No
5	?	?	PUNCT	.	_	4	punct	_	_
```

<!-- .fr -->
| # | verb | tense, mood | who | what, whom | to whom | where | when | other | roles by |
| --- | --- | --- | --- | --- | --- | --- | --- | --- | --- |
| 1 | **trust** | should | Lily |  |  |  |  |  | vn conjecture-29.5-1 «NP V NP»: agent=Agent what=Theme |

## The options {#options}

### Option 1 · ← Mova's choice {#o1}

<!-- .ven lang=en -->
The first answer, because first is best

```conllu
# sent_id = question:ai:5-hallucinations-confident-made-up-answers:t8:o1:1
# text = The first answer, because first is best
1	The	the	DET	DT	Definite=Def|PronType=Art	3	det	_	_
2	first	first	ADJ	JJ	Degree=Pos|NumForm=Word|NumType=Ord	3	amod	_	_
3	answer	answer	NOUN	NN	Number=Sing	8	nsubj	_	SpaceAfter=No
4	,	,	PUNCT	,	_	3	punct	_	_
5	because	because	ADP	IN	ExtPos=ADP	6	case	_	_
6	first	first	ADV	RB	NumForm=Word|NumType=Ord	3	nmod	_	_
7	is	be	AUX	VBZ	Mood=Ind|Number=Sing|Person=3|Tense=Pres|VerbForm=Fin	8	cop	_	_
8	best	good	ADJ	JJS	Degree=Sup	0	root	_	_
```

<!-- .fr -->
| # | verb | tense, mood | who | what, whom | to whom | where | when | other | roles by |
| --- | --- | --- | --- | --- | --- | --- | --- | --- | --- |
| 1 | **is** | present | the first answer |  |  |  |  | good *property* | tree rules |

### Option 2 {#o2}

<!-- .ven lang=en -->
The second answer, because it's newer and better

```conllu
# sent_id = question:ai:5-hallucinations-confident-made-up-answers:t8:o2:1
# text = The second answer, because it's newer and better
1	The	the	DET	DT	Definite=Def|PronType=Art	3	det	_	_
2	second	second	ADJ	JJ	Degree=Pos|NumForm=Word|NumType=Ord	3	amod	_	_
3	answer	answer	NOUN	NN	Number=Sing	0	root	_	SpaceAfter=No
4	,	,	PUNCT	,	_	8	punct	_	_
5	because	because	SCONJ	IN	_	8	mark	_	_
6	it	it	PRON	PRP	Case=Nom|Gender=Neut|Number=Sing|Person=3|PronType=Prs	8	nsubj	_	SpaceAfter=No
7	's	be	AUX	VBZ	Mood=Ind|Number=Sing|Person=3|Tense=Pres|VerbForm=Fin	8	cop	_	_
8	newer	new	ADJ	JJR	Degree=Cmp	3	amod	_	_
9	and	and	CCONJ	CC	_	10	cc	_	_
10	better	good	ADJ	JJR	Degree=Cmp	8	conj	_	_
```

<!-- .fr -->
| # | verb | tense, mood | who | what, whom | to whom | where | when | other | roles by |
| --- | --- | --- | --- | --- | --- | --- | --- | --- | --- |
| 1 | **is** | present | answer |  |  |  |  | new *property* | tree rules |
| 2 | **be** |  | answer *not said here* |  |  |  |  |  | tree rules |

### Option 3 {#o3}

<!-- .ven lang=en -->
Whichever answer is shorter

```conllu
# sent_id = question:ai:5-hallucinations-confident-made-up-answers:t8:o3:1
# text = Whichever answer is shorter
1	Whichever	whichever	NOUN	NN	Number=Sing	2	compound	_	_
2	answer	answer	NOUN	NN	Number=Sing	4	nsubj	_	_
3	is	be	AUX	VBZ	Mood=Ind|Number=Sing|Person=3|Tense=Pres|VerbForm=Fin	4	cop	_	_
4	shorter	short	ADJ	JJR	Degree=Cmp	0	root	_	_
```

<!-- .fr -->
| # | verb | tense, mood | who | what, whom | to whom | where | when | other | roles by |
| --- | --- | --- | --- | --- | --- | --- | --- | --- | --- |
| 1 | **is** | present | Whichever answer |  |  |  |  | short *property* | tree rules |

### Option 4 · ✓ the right answer {#o4}

<!-- .ven lang=en -->
Reasons she can check, not the bot's last word

```conllu
# sent_id = question:ai:5-hallucinations-confident-made-up-answers:t8:o4:1
# text = Reasons she can check, not the bot's last word
1	Reasons	reason	NOUN	NNS	Number=Plur	4	nsubj	_	_
2	she	she	PRON	PRP	Case=Nom|Gender=Fem|Number=Sing|Person=3|PronType=Prs	4	nsubj	_	_
3	can	can	AUX	MD	VerbForm=Fin	4	aux	_	_
4	check	check	VERB	VB	VerbForm=Inf	0	root	_	SpaceAfter=No
5	,	,	PUNCT	,	_	11	punct	_	_
6	not	not	PART	RB	Polarity=Neg	11	advmod	_	_
7	the	the	DET	DT	Definite=Def|PronType=Art	8	det	_	_
8	bot	bot	NOUN	NN	Number=Sing	11	nmod:poss	_	SpaceAfter=No
9	's	's	PART	POS	_	8	case	_	_
10	last	last	ADJ	JJ	Degree=Pos	11	amod	_	_
11	word	word	NOUN	NN	Number=Sing	4	obl	_	_
```

<!-- .fr -->
| # | verb | tense, mood | who | what, whom | to whom | where | when | other | roles by |
| --- | --- | --- | --- | --- | --- | --- | --- | --- | --- |
| 1 | **check** | can | Reasons | the bot's last word |  |  |  |  | vn assessment-34.1 «NP V NP»: agent=Agent |
| 2 | **word** |  | the bot |  |  |  |  |  | nom word «communication transitive»: poss=agent |

<!-- div src -->

**Text:** the tests of Mova's primary school, written for Mova (`world/data/school/`), as the course runner gave them to the student. **Trees:** Mova's own parse — the `en` model on the CPU, when the site is built — not checked by a teacher; they may be wrong. **Frames:** Mova's frames reader (`prag`), each text read on its own. Elamur Cosmic License.

<!-- /div -->

<!-- pn -->
- ← previous: [Hallucinations: confident made-up answ…, test 7](https://md.mova.elamur.ai/free/en/corpora/questions/ai/5-hallucinations-confident-made-up-answers/t7/)
- next →: [Hallucinations: confident made-up answ…, test 9](https://md.mova.elamur.ai/free/en/corpora/questions/ai/5-hallucinations-confident-made-up-answers/t9/)
- ↑ back to [Hallucinations: confident made-up answers](https://md.mova.elamur.ai/free/en/corpora/questions/ai/5-hallucinations-confident-made-up-answers/)