NEWVectors or files. Pick a path.Start →
    Models/Captioning/WorldSeek-AI/WorldSeek-Omni-2B-Preview
    HFScene CaptioningApache 2.0

    WorldSeek-Omni-2B-Preview

    by WorldSeek-AI

    Compact any-to-any omni model for text, image, video, and audio perception

    Identifiers
    Model ID
    WorldSeek-AI/WorldSeek-Omni-2B-Preview
    Feature URI
    mixpeek://video_extractor@v1/worldseek_omni_2b_preview_v1

    Overview

    WorldSeek Omni 2B Preview is a compact any-to-any model that combines text, image, video, and audio inputs. It is built from Qwen language and ASR components and is positioned for multimodal understanding rather than a single isolated extraction task.

    On Mixpeek, it is relevant for agent perception workflows that need one compact model to inspect a retrieved image, listen to a clip, or reason over a short video segment before deciding the next tool call.

    Architecture

    Transformer-based any-to-any model with Qwen and Qwen3-ASR base components. The model card lists text, image, video, and audio tags with Apache 2.0 licensing.

    Mixpeek SDK Integration

    // No extractor parameter takes a Hugging Face model id (checked against
    // GET /v1/discovery/extractors, which returns 13), so WorldSeek-Omni-2B-Preview runs
    // on your side and the output is upserted through POST
    // /v1/namespaces/{namespace_id}/documents/upsert. On Enterprise the other
    // path is to upload the weights instead: POST /v1/namespaces/{id}/models
    // accepts the huggingface format and a custom plugin loads them.
    const res = await fetch(
      "https://api.mixpeek.com/v1/namespaces/ns_your_namespace/documents/upsert",
      {
        method: "POST",
        headers: {
          Authorization: "Bearer API_KEY",
          "Content-Type": "application/json",
        },
        body: JSON.stringify({
          collection_id: "col_your_collection",
          documents: [
            {
              document_id: "asset-00412",
              // The model produces text, so it lands in payload. Give the
              // collection a text vector index and embed that text to make it
              // searchable rather than only filterable.
              payload: { extracted_text: modelOutput, source_key: "archive/2026/asset-00412" },
              vectors: { "multimodal-embedding": embeddingOfModelOutput },
            },
          ],
        }),
      },
    );
    
    // Managed alternative, if this exact model is not the requirement:
    // universal_extractor@v1 runs google/gemini-embedding-2
    // (3072-d) over a bucket, with no inference of your own.

    Capabilities

    • Text, image, video, and audio input support
    • Compact 2B-class omni model
    • Any-to-any task framing
    • Apache 2.0 license

    Use Cases on Mixpeek

    Agent perception over retrieved mixed-media evidence
    Audio-visual content inspection after retrieval
    Compact multimodal reasoning for short clips and screenshots

    Specification

    FrameworkHF
    OrganizationWorldSeek-AI
    FeatureScene Captioning
    Outputtext
    Modalitiesvideo, image
    RetrieverSemantic Search
    Parameters2B preview
    LicenseApache 2.0
    Downloads/mo21

    Research Paper

    WorldSeek Omni 2B Preview

    arxiv.org

    Build a pipeline with WorldSeek-Omni-2B-Preview

    Add this model to a processing pipeline alongside other extractors. Combine with retrieval stages for end-to-end search.

    Run it on your own data, free