NEWVectors or files. Pick a path.Start →
    Models/Embeddings/google/siglip-base-patch16-224
    HFVisual Embeddingsapache-2.0

    siglip-base-patch16-224

    by google

    Sigmoid Loss for Language Image Pre-Training, efficient contrastive learning

    1.4Mdl/month
    89likes
    203Mparams
    Identifiers
    Model ID
    google/siglip-base-patch16-224
    Feature URI
    mixpeek://image_extractor@v1/google_siglip_base_v1

    Overview

    SigLIP replaces CLIP's softmax-based contrastive loss with a simple pairwise sigmoid loss, enabling more efficient training on larger batch sizes without requiring a global normalization step.

    On Mixpeek, SigLIP offers a lighter-weight alternative to CLIP for visual embedding extraction, with comparable accuracy on many benchmarks while being faster to run at inference time.

    Architecture

    Vision Transformer (ViT-B/16) with 12 layers, 768-dim hidden size, 12 attention heads. Uses sigmoid contrastive loss instead of softmax, eliminating the need for large batch normalization.

    Mixpeek SDK Integration

    // No extractor parameter takes a Hugging Face model id (checked against
    // GET /v1/discovery/extractors, which returns 13), so siglip-base-patch16-224 runs
    // on your side and the output is upserted through POST
    // /v1/namespaces/{namespace_id}/documents/upsert. On Enterprise the other
    // path is to upload the weights instead: POST /v1/namespaces/{id}/models
    // accepts the huggingface format and a custom plugin loads them.
    const res = await fetch(
      "https://api.mixpeek.com/v1/namespaces/ns_your_namespace/documents/upsert",
      {
        method: "POST",
        headers: {
          Authorization: "Bearer API_KEY",
          "Content-Type": "application/json",
        },
        body: JSON.stringify({
          collection_id: "col_your_collection",
          documents: [
            {
              document_id: "asset-00412",
              // The vector name has to match a vector index on the collection.
              vectors: { "image-embedding": yourVector },
              payload: { source_key: "archive/2026/asset-00412" },
            },
          ],
        }),
      },
    );
    
    // Managed alternative, if this exact model is not the requirement:
    // image_extractor@v1 runs google/siglip-base-patch16-224
    // (768-d) over a bucket, with no inference of your own.

    Capabilities

    • Efficient contrastive image-text learning
    • 768-dimensional dense vector embeddings
    • Lower memory footprint than CLIP ViT-L
    • Strong zero-shot classification performance

    Use Cases on Mixpeek

    High-throughput visual indexing of large image catalogs
    Real-time visual similarity for recommendation engines
    Lightweight embedding extraction for edge deployments

    Benchmarks

    DatasetMetricScoreSource
    ImageNet zero-shotTop-1 Accuracy73.2%Zhai et al., 2023: Table 1
    COCO (image→text)Recall@162.7%Zhai et al., 2023: Table 3
    ObjectNetTop-1 Accuracy59.1%Zhai et al., 2023: Table 2

    Performance

    Input Size224×224 px
    Embedding Dim768
    GPU Latency~6ms / image (A100)
    CPU Latency~70ms / image
    GPU Throughput~165 images/sec (A100)
    GPU Memory~1.1 GB

    Specification

    FrameworkHF
    Organizationgoogle
    FeatureVisual Embeddings
    Output768-dim vector
    Modalitiesvideo, image
    RetrieverVector Search
    Parameters203M
    Licenseapache-2.0
    Downloads/mo1.4M
    Likes89

    Research Paper

    Sigmoid Loss for Language Image Pre-Training

    arxiv.org

    Build a pipeline with siglip-base-patch16-224

    Add this model to a processing pipeline alongside other extractors. Combine with retrieval stages for end-to-end search.

    Run it on your own data, free