Skip to content
For the complete documentation index, see llms.txt. This page is also available as Markdown.

Evaluate retrieval

Evaluate searches a knowledge base directly. Use it to inspect which source passages a query retrieves and how search settings affect the results.

Before you start

Open a knowledge base containing Indexed documents. Choose a question with an answer you can locate in an original source. Follow Create a knowledge base if the collection is not ready.

Start with a search question

In Evaluate, enter a question and inspect a returned passage and its source.

Knowledge base query and results

Start with information you can locate in the documents so you can judge relevance directly.

Set the result limit

Open Advanced Settings and adjust Top K while retaining the search method.

Retrieval result limit setting

Top K sets the maximum number of results. It does not guarantee that many results.

Choose a search method

Choose Keyword when you need to compare literal term matching.

Retrieval search method selection

Apply the setting and inspect the passages returned for the exact term.

Switch to Hybrid and run the same query to compare results.

Retrieval search method selection

Evaluate the usefulness of the passages rather than treating scores from different methods as interchangeable.

Choose the retrieval unit and order

Choose Documents as the retrieval unit when comparing document-level results.

Retrieval unit and sorting options

Use sources with enough content to understand how this differs from returning individual chunks.

Open Filters to inspect sorting by score or chunk.

Retrieval unit and sorting options

The order can change what you see first without changing the question you submitted.

Choose Pages to inspect page-based retrieval results.

Retrieval unit and sorting options

Check the page labels against the source, especially when a document has several pages.

Reset evaluator settings

Select Reset, then Apply to return the evaluator to its default settings.

Retrieval evaluator reset controls

Run the query again to see results with those settings.

Important behavior

Top K is a maximum result count. The search may return fewer results.

Scores from different search methods are not directly interchangeable. Compare the relevance of the returned content.

Evaluate settings apply to the evaluator. Configure workflow search parameters separately.

Continue

Last updated

Was this helpful?