NEWVectors or files. Pick a path.Start →
    Models/Captioning/zai-org/GLM-4.5V
    HFScene CaptioningMIT

    GLM-4.5V

    by zai-org

    Flagship GLM vision-language model for multimodal reasoning across images, video, documents, and GUIs

    177Kdl/month
    106B total, 12B activeparams
    Identifiers
    Model ID
    zai-org/GLM-4.5V
    Feature URI
    mixpeek://image_extractor@v1/zai_glm_45v_v1

    Overview

    GLM-4.5V is a Z.ai vision-language model built on the GLM-4.5-Air foundation model. The model card positions it for real-world multimodal reasoning rather than simple captioning: image reasoning, long video segmentation, event recognition, GUI tasks, chart parsing, long document parsing, and visual grounding.

    On Mixpeek, GLM-4.5V is a strong scene captioning option when agents need a searchable natural-language layer over complex visual data. It can turn frames, screenshots, charts, and video segments into retrieval-ready descriptions that preserve the evidence an agent needs for later reasoning.

    Architecture

    Vision-language model from the GLM-V family, based on GLM-4.5-Air with 106B total parameters and 12B active parameters. The model supports a thinking mode that trades speed for deeper multimodal reasoning, and its training emphasizes image, video, document, GUI, and grounding tasks.

    Mixpeek SDK Integration

    // No extractor parameter takes a Hugging Face model id (checked against
    // GET /v1/discovery/extractors, which returns 13), so GLM-4.5V runs
    // on your side and the output is upserted through POST
    // /v1/namespaces/{namespace_id}/documents/upsert. On Enterprise the other
    // path is to upload the weights instead: POST /v1/namespaces/{id}/models
    // accepts the huggingface format and a custom plugin loads them.
    const res = await fetch(
      "https://api.mixpeek.com/v1/namespaces/ns_your_namespace/documents/upsert",
      {
        method: "POST",
        headers: {
          Authorization: "Bearer API_KEY",
          "Content-Type": "application/json",
        },
        body: JSON.stringify({
          collection_id: "col_your_collection",
          documents: [
            {
              document_id: "asset-00412",
              // The model produces text, so it lands in payload. Give the
              // collection a text vector index and embed that text to make it
              // searchable rather than only filterable.
              payload: { extracted_text: modelOutput, source_key: "archive/2026/asset-00412" },
              vectors: { "multimodal-embedding": embeddingOfModelOutput },
            },
          ],
        }),
      },
    );
    
    // Managed alternative, if this exact model is not the requirement:
    // universal_extractor@v1 runs google/gemini-embedding-2
    // (3072-d) over a bucket, with no inference of your own.

    Capabilities

    • Image reasoning and multi-image scene analysis
    • Video understanding with segmentation and event recognition
    • Chart, report, and long document parsing
    • GUI screen reading and visual element localization
    • Bilingual Chinese and English multimodal reasoning

    Use Cases on Mixpeek

    Create searchable captions for complex video and screenshot archives
    Index charts, reports, and slides where text extraction alone is not enough
    Give agents a visual evidence layer before expensive follow-up reasoning
    Ground object, UI, or document references back to source frames

    Benchmarks

    DatasetMetricScoreSource
    42 public vision-language benchmarksRelative rankSOTA among same-scale modelsZ.ai GLM-4.5V model card
    GLM-V task coverageModalitiesImage, video, document, GUI, groundingZ.ai GLM-4.5V model card

    Performance

    Input SizeImages, screenshots, documents, or sampled video frames
    GPU LatencyInput dependent
    GPU ThroughputBatch dependent
    GPU MemoryLarge MoE deployment

    Use for high-value enrichment where reasoning quality matters more than low-latency bulk captioning

    Specification

    FrameworkHF
    Organizationzai-org
    FeatureScene Captioning
    Outputtext
    Modalitiesvideo, image
    RetrieverSemantic Search
    Parameters106B total, 12B active
    LicenseMIT
    Downloads/mo177K

    Research Paper

    GLM-4.1V-Thinking and GLM-4.5V

    arxiv.org

    Build a pipeline with GLM-4.5V

    Add this model to a processing pipeline alongside other extractors. Combine with retrieval stages for end-to-end search.

    Run it on your own data, free