Skip to main content

Why an assistant sometimes gets it wrong

Common reasons an assistant gives a wrong answer, from the wrong type or collections to unready files and settings, and how to check each one.

Written by Romain Morvant

An assistant can still miss, even when it looks up your files. Check the type, the collections, and whether a file is Ready, before you assume the model is broken.

It looked in the wrong place

An admin assistant is for deadlines, LMS navigation, and FAQs. It will not stay on your course materials. A course assistant is the default when that admin type is off.

Open the knowledge base and confirm the linked collections belong to this course. An extra collection, or a missing one, changes what it can cite.

If you use a timeline, the current period limits which resources the assistant may use. A period with the wrong files will answer from those files only.

The file is not ready, or the extract is off

A resource still processing, waiting, to review, or in error is a weak source. Wait until it is Ready, or open the resource and check the extracted text. If that extract is wrong, the assistant will repeat the error.

The Knowledge bases table on the Collections tab, showing a collection with the status To review, its resource count, linked assistant and last updated date.

Search returns passages, not the whole document. A vague question, or one that uses different words from the file, can retrieve the wrong excerpt. Rephrase with the terms the course actually uses.

A setting let it leave the materials

In learner experience settings, general knowledge lets the assistant fall back outside your resources. Web search lets a learner search the web for that message. Turn them off if you need answers only from your materials.

It can still misread a good passage

Grounding does not make every sentence correct. The assistant can summarise too loosely, mix two excerpts, or sound confident when the file only partly covers the question.

Open Sources on the latest answer (or View sources on an older one) and compare the reply to the cited passage. If resource sharing is off, learners cannot do that check. You can still test in Preview.

The Sources dialog opened from a preview chat answer, showing two cited passages from course resources.

Related

Need help? Write to [email protected].

Did this answer your question?