NEWVectors or files. Pick a path.Start →
    Models/Reranking/mixedbread-ai/mxbai-rerank-large-v2
    HFRerankingApache 2.0

    mxbai-rerank-large-v2

    by mixedbread-ai

    RL-trained text reranker with state-of-the-art accuracy

    Identifiers
    Model ID
    mixedbread-ai/mxbai-rerank-large-v2
    Feature URI
    mixpeek://reranker@v1/mxbai_rerank_large_v2

    Overview

    mxbai-rerank-large-v2 is a cross-encoder reranking model from mixedbread.ai, trained using reinforcement learning from human feedback (RLHF) on top of a large transformer backbone. It achieves state-of-the-art reranking accuracy on BEIR and other standard benchmarks, outperforming many models several times its size. The model uses a cross-attention architecture that jointly encodes query-document pairs for fine-grained relevance scoring.

    Architecture

    Cross-encoder transformer with RLHF fine-tuning. Processes concatenated query-document pairs through full cross-attention layers, producing a single relevance score. The RL training phase uses preference data to calibrate scores toward human judgment of relevance, improving ranking quality beyond supervised-only approaches.

    Mixpeek SDK Integration

    // Reranking is a retriever STAGE in Mixpeek, not an ingest-time extractor.
    // The rerank stage runs a cross-encoder inference service; the shipped default
    // is BAAI/bge-reranker-v2-m3. Pointing it at mxbai-rerank-large-v2 means registering that
    // model as a custom reranker plugin and naming it in feature_uri, which is an
    // Enterprise path. Stage contract read from GET /v1/discovery/stages.
    const retriever = await mx.retrievers.create({
      namespace_id: "my-namespace",
      retriever_name: "search-then-rerank",
      stages: [
        {
          stage_name: "candidates",
          stage_id: "feature_search",
          parameters: { limit: 100 },
        },
        {
          stage_name: "rerank_results",
          stage_id: "rerank",
          parameters: {
            inference_name: "BAAI__bge_reranker_v2_m3",
            query: "{{INPUT.query}}",
            document_field: "content",
            top_k: 10,
          },
        },
      ],
    });

    Capabilities

    • Text reranking
    • Passage relevance scoring
    • Search result refinement
    • RAG pipeline optimization

    Use Cases on Mixpeek

    Re-scoring first-stage retrieval results for higher precision
    Improving RAG answer quality by surfacing the most relevant passages
    E-commerce search ranking refinement
    Legal and compliance document retrieval

    Benchmarks

    DatasetMetricScoreSource
    BEIR (avg)nDCG@1059.8Model card
    MS MARCO DevMRR@1042.1Model card
    TREC-DL 2020nDCG@1074.5Model card

    Performance

    Input SizeVariable
    GPU Latency~45ms per query-doc pair on A100
    GPU Throughput~350 pairs/sec batch
    GPU MemoryModel dependent

    Specification

    FrameworkHF
    Organizationmixedbread-ai
    FeatureReranking
    OutputRelevance score per candidate
    Modalities
    RetrieverCross-Modal Reranker
    Parameters560M
    LicenseApache 2.0
    Downloads/mo475K

    Research Paper

    Model paper or technical report

    arxiv.org

    Build a pipeline with mxbai-rerank-large-v2

    Add this model to a processing pipeline alongside other extractors. Combine with retrieval stages for end-to-end search.

    Run it on your own data, free