sam3

by facebook

Concept-level segmentation with open-vocabulary detection and video tracking

420Kdl/month

848Mparams

Source Use in Pipeline

Identifiers

Model ID

facebook/sam3

Feature URI

mixpeek://image_extractor@v1/facebook_sam3_v1

Overview

SAM 3 is Meta's unified foundation model for concept-level segmentation. It detects, segments, and tracks objects using open-vocabulary text prompts or visual exemplars, handling 270K+ unique concepts. It bridges the gap between detection and segmentation in a single model.

On Mixpeek, SAM 3 enables concept-driven content analysis — specify any concept in text and SAM 3 will find, segment, and track every instance across images and video.

Architecture

Decoupled detector-tracker architecture sharing a vision encoder. 848M total parameters. Uses a presence token for discriminating closely related prompts. Trained on 4M+ automatically annotated concepts.

Mixpeek SDK Integration

import { Mixpeek } from "mixpeek";

const mx = new Mixpeek({ apiKey: "API_KEY" });

await mx.collections.ingest({
  collection_id: "my-collection",
  source: { url: "https://example.com/video.mp4" },
  feature_extractors: [{
    name: "segmentation",
    version: "v1",
    params: { model_id: "facebook/sam3" }
  }]
});