Toto-2.0-2.5B
by Datadog
#1 time series foundation model: zero-shot forecasting from 4M to 2.5B parameters
Datadog/Toto-2.0-2.5Bmixpeek://forecasting@v1/datadog_toto_20_25b_v1Overview
Toto 2.0 is Datadog's time series foundation model that ranks #1 on every major forecasting benchmark (BOOM, GIFT-Eval, TIME). Built on a decoder-only patched transformer with alternating time-axis and variate-axis attention, it performs zero-shot multivariate forecasting with probabilistic uncertainty estimates: no fine-tuning required on target data.
The 2.5B flagship model sits atop a family spanning 4M to 2.5B parameters, all trained with a single hyperparameter recipe (u-muP) that transfers across scales. Contiguous Patch Masking enables single-pass parallel decoding of entire forecast horizons, making inference dramatically faster than autoregressive approaches.
On Mixpeek, Toto powers predictive analytics on ingestion metrics, query latency trends, and pipeline throughput forecasting, turning historical observability data into actionable capacity planning signals.
Architecture
Decoder-only patched transformer with alternating time-axis (causal) and variate-axis (full) attention layers. Contiguous Patch Masking (CPM) for single-pass parallel decoding. Quantile output head (9 levels) trained with pinball loss. Robust arcsinh input scaling. u-muP parameterization enables a single training recipe from 4M to 2.5B. Variable context and prediction lengths.
Mixpeek SDK Integration
// No extractor parameter takes a Hugging Face model id (checked against
// GET /v1/discovery/extractors, which returns 13), so Toto-2.0-2.5B runs
// on your side and the output is upserted through POST
// /v1/namespaces/{namespace_id}/documents/upsert. On Enterprise the other
// path is to upload the weights instead: POST /v1/namespaces/{id}/models
// accepts the huggingface format and a custom plugin loads them.
const res = await fetch(
"https://api.mixpeek.com/v1/namespaces/ns_your_namespace/documents/upsert",
{
method: "POST",
headers: {
Authorization: "Bearer API_KEY",
"Content-Type": "application/json",
},
body: JSON.stringify({
collection_id: "col_your_collection",
documents: [
{
document_id: "asset-00412",
// The vector name has to match a vector index on the collection.
vectors: { "multimodal-embedding": yourVector },
payload: { source_key: "archive/2026/asset-00412" },
},
],
}),
},
);
// Managed alternative, if this exact model is not the requirement:
// multimodal_extractor@v2 runs google/gemini-embedding-2
// (3072-d) over a bucket, with no inference of your own.Capabilities
- #1 foundation model on BOOM, GIFT-Eval, and TIME benchmarks
- Zero-shot forecasting: no fine-tuning needed on target time series
- Probabilistic predictions with 9-quantile uncertainty estimates
- Scales from 4M to 2.5B params with monotonic quality improvement
- Single-pass parallel decoding via Contiguous Patch Masking
Use Cases on Mixpeek
Benchmarks
| Dataset | Metric | Score | Source |
|---|---|---|---|
| BOOM (observability) | CRPS | 0.349 | Datadog, 2026: Model Card |
| GIFT-Eval (general) | CRPS | 0.476 | Datadog, 2026: Model Card |
| TIME (contamination-resistant) | CRPS | 0.532 | Datadog, 2026: Model Card |
Performance
Common Pipeline Companions
Explore on Mixpeek
Compare alternatives in this category
Hand-picked tools & platforms compared
Deep-dive technical guide
See how Mixpeek runs models as extractors
Store & search embeddings at scale
Usage-based pricing for pipelines
Compare models, APIs & infrastructure
Specification
Research Paper
This Time is Different: An Observability Perspective on Time Series Foundation Models
arxiv.orgBuild a pipeline with Toto-2.0-2.5B
Add this model to a processing pipeline alongside other extractors. Combine with retrieval stages for end-to-end search.
Run it on your own data, free