VLM2Vec-V2.0
by VLM2Vec
Compact multimodal embedding for images, videos, and visual documents
VLM2Vec/VLM2Vec-V2.0mixpeek://image_extractor@v1/vlm2vec_v2_v1Overview
VLM2Vec V2 is a 2B-parameter multimodal embedding model that punches above its weight, achieving results competitive with 7B models on the MMEB-V2 benchmark. Built on Qwen2-VL-2B-Instruct with LoRA fine-tuning, it introduced the MMEB-V2 benchmark itself, extending evaluation to video retrieval, moment retrieval, and video QA.
On Mixpeek, VLM2Vec V2 is the best choice when you need multimodal embeddings at scale without the memory overhead of larger models. At 2B parameters, it runs on a single consumer GPU while delivering competitive cross-modal retrieval quality.
Architecture
Qwen2-VL-2B-Instruct with LoRA fine-tuning. Last-token pooling with normalization. Trained on MMEB-train (2.14M samples) with batch size 1024 for 2K steps, temperature 0.02. Configurable fps and max_pixels for video input.
Mixpeek SDK Integration
// No extractor parameter takes a Hugging Face model id (checked against
// GET /v1/discovery/extractors, which returns 13), so VLM2Vec-V2.0 runs
// on your side and the output is upserted through POST
// /v1/namespaces/{namespace_id}/documents/upsert. On Enterprise the other
// path is to upload the weights instead: POST /v1/namespaces/{id}/models
// accepts the huggingface format and a custom plugin loads them.
const res = await fetch(
"https://api.mixpeek.com/v1/namespaces/ns_your_namespace/documents/upsert",
{
method: "POST",
headers: {
Authorization: "Bearer API_KEY",
"Content-Type": "application/json",
},
body: JSON.stringify({
collection_id: "col_your_collection",
documents: [
{
document_id: "asset-00412",
// The vector name has to match a vector index on the collection.
vectors: { "multimodal-embedding": yourVector },
payload: { source_key: "archive/2026/asset-00412" },
},
],
}),
},
);
// Managed alternative, if this exact model is not the requirement:
// multimodal_extractor@v2 runs google/gemini-embedding-2
// (3072-d) over a bucket, with no inference of your own.Capabilities
- Competitive with 7B models at 2B parameters
- Image, video, and visual document embeddings
- Video retrieval, moment retrieval, and video classification
- Configurable video frame rate and resolution
- 58.0 overall on MMEB-V2 (78 tasks)
Use Cases on Mixpeek
Benchmarks
| Dataset | Metric | Score | Source |
|---|---|---|---|
| MMEB-V2 (78 tasks) | Overall | 58.0 | TIGER-Lab, 2025: arxiv,2507.04590 |
| MMEB-V2 Image (36 tasks) | Hit@1 | 64.9 | TIGER-Lab, 2025: arxiv,2507.04590 |
| MMEB-V2 VisDoc (24 tasks) | nDCG@5 | 65.4 | TIGER-Lab, 2025: arxiv,2507.04590 |
Performance
Common Pipeline Companions
Explore on Mixpeek
Compare alternatives in this category
Hand-picked tools & platforms compared
Deep-dive technical guide
See how Mixpeek runs models as extractors
Store & search embeddings at scale
Usage-based pricing for pipelines
Compare models, APIs & infrastructure
Specification
Research Paper
VLM2Vec-V2: Advancing Multimodal Embedding for Videos, Images, and Visual Documents
arxiv.orgBuild a pipeline with VLM2Vec-V2.0
Add this model to a processing pipeline alongside other extractors. Combine with retrieval stages for end-to-end search.
Run it on your own data, free