NEWVectors or files. Pick a path.Start →
    Models/Text Extraction/ibm-granite/granite-vision-4.1-4b
    HFOCRApache 2.0

    granite-vision-4.1-4b

    by ibm-granite

    Specialized VLM for extracting structured data from charts, tables, and forms

    Identifiers
    Model ID
    ibm-granite/granite-vision-4.1-4b
    Feature URI
    mixpeek://image_extractor@v1/ibm_granite_vision_41_4b_v1

    Overview

    Granite Vision 4.1 is IBM's purpose-built document extraction model that converts visual content (charts, tables, forms, key-value pairs) into structured machine-readable formats (CSV, JSON, HTML). Unlike general-purpose VLMs that describe what they see, Granite Vision extracts precise data values with high accuracy, making it suitable for automated document processing pipelines.

    On Mixpeek, Granite Vision powers structured extraction from document pages: converting chart images to CSV data, table images to JSON records, and form images to key-value pairs. This structured output is directly indexable and filterable, unlike free-text captions.

    Architecture

    LoRA adapter on Granite-4.1-3B vision-language model. 4B total parameters (3.4B LLM + 0.6B vision encoder/projectors). Trained specifically on document extraction tasks: chart-to-CSV, table-to-JSON/HTML, key-value pair extraction. Integrates with IBM Docling for production pipelines.

    Mixpeek SDK Integration

    // No extractor parameter takes a Hugging Face model id (checked against
    // GET /v1/discovery/extractors, which returns 13), so granite-vision-4.1-4b runs
    // on your side and the output is upserted through POST
    // /v1/namespaces/{namespace_id}/documents/upsert. On Enterprise the other
    // path is to upload the weights instead: POST /v1/namespaces/{id}/models
    // accepts the huggingface format and a custom plugin loads them.
    const res = await fetch(
      "https://api.mixpeek.com/v1/namespaces/ns_your_namespace/documents/upsert",
      {
        method: "POST",
        headers: {
          Authorization: "Bearer API_KEY",
          "Content-Type": "application/json",
        },
        body: JSON.stringify({
          collection_id: "col_your_collection",
          documents: [
            {
              document_id: "asset-00412",
              // The model produces text, so it lands in payload. Give the
              // collection a text vector index and embed that text to make it
              // searchable rather than only filterable.
              payload: { extracted_text: modelOutput, source_key: "archive/2026/asset-00412" },
              vectors: { "text-embedding": embeddingOfModelOutput },
            },
          ],
        }),
      },
    );
    
    // Managed alternative, if this exact model is not the requirement:
    // document_graph_extractor@v1 runs intfloat/multilingual-e5-large-instruct
    // (1024-d) over a bucket, with no inference of your own.

    Capabilities

    • Chart to CSV extraction with high precision
    • Table to JSON/HTML structured output
    • Key-value pair extraction (94.2% exact-match on VAREX)
    • Apache 2.0 license for unrestricted commercial use
    • LoRA adapter: lightweight deployment on top of Granite-4.1-3B

    Use Cases on Mixpeek

    Financial document processing: extract data from charts and tables in reports
    Invoice automation: extract line items, totals, and metadata into structured records
    Research data extraction: convert published figures and tables into analyzable data
    Form processing: extract key-value pairs from government and enterprise forms

    Benchmarks

    DatasetMetricScoreSource
    VAREX (key-value extraction)Exact-match accuracy (zero-shot)94.2%IBM Research, 2026: Model Card

    Performance

    Input SizeDocument page image
    GPU Latency~40ms / page (A100)
    GPU Throughput~25 pages/sec (A100)
    GPU Memory~8 GB

    Specification

    FrameworkHF
    Organizationibm-granite
    FeatureOCR
    Outputtext + bbox
    Modalitiesvideo, image, document
    RetrieverText-in-Image
    Parameters4B
    LicenseApache 2.0
    Downloads/mo39K

    Research Paper

    Granite Vision 4.1 for Document Extraction

    arxiv.org

    Build a pipeline with granite-vision-4.1-4b

    Add this model to a processing pipeline alongside other extractors. Combine with retrieval stages for end-to-end search.

    Run it on your own data, free