Skip to main content
Retriever enrichments: document ingested, inputs mapped to retriever, pipeline executes, selected fields written back to document
Retriever enrichments let you attach arbitrary retriever pipelines to collections. When documents are ingested, the configured retrievers execute against each document and write selected result fields back to the document. This enables LLM classification, cross-collection joins, and multi-stage enrichment without building custom extractor plugins.

How It Works

  1. Attach a retriever enrichment to a collection with input mappings and write-back field configuration
  2. Ingest documents via batch processing as usual
  3. Post-processing executes the retriever for each document, mapping document fields to retriever inputs
  4. Write-back extracts specified fields from retriever results and writes them to the document
Retriever enrichments run in Phase 4 of post-processing by default (after taxonomies, clusters, and alerts), but you can configure them to run in any phase.

Configuration

Each retriever enrichment has three main sections:

Input Mappings

Map document fields or constant values to retriever input parameters:

Write-Back Fields

Configure which retriever result fields to write back to documents:
Write-back modes:

Execution Control

Example: LLM Classification at Ingestion

Attach a retriever with an llm_enrich stage to classify documents as they’re ingested:

Example: Cross-Collection Join

Use a retriever enrichment to join data from a reference collection:
Retriever enrichments execute sequentially within each collection to avoid race conditions. For collections with many documents, enrichment time scales linearly with document count.

Comparison with Other Enrichment Types