🎉 TwelveLabs Raises $100M Series B to build the future of video superintelligence. Read more.

Platform

Pricing

Solutions

Build

Resources

Company

Select Language

Playground

Talk to Sales

🎉 TwelveLabs Raises $100M Series B to build the future of video superintelligence. Read more.

PEGASUS 1.5

Turn raw video into structured data.

A video-to-text model that defines key events like speaker changes, brand appearances, plays, policy violations and returns time-coded JSON in one API call.

2hrs

Max video duration with full temporal context retained end-to-end.

Languages supported across input prompts and generated output.

Pre-indexing steps. Send a URL, an asset, or base64, get text back.

JSON

Structured segmentation output ready for your editor, or pipeline.

Things only Pegasus does.

General-purpose VLMs paste frames together and call it understanding. Pegasus is built for video, and the gap shows as soon as your prompt mentions a timestamp.

The answer comes with a timestamp.

Pegasus answers with exact timestamp, not “somewhere in the middle.” Granular temporal reasoning is built into the model.

Reads the fine print.

On-screen text. Jersey numbers. Whiteboards. Receipts. Pegasus parses the frame alongside the speech track, so summaries include the slides too.

From a raw video to structured JSON.

Define a segment such as a speaker change, brand appearance, or scene cut, choose your fields, and Pegasus returns timestamped JSON.

Reference an image. Ask about it.

Drop in a reference image such as a logo, face, or product, and Pegasus uses it as visual context.

From signup to first result in 5 minutes.

Same model, prompts, and JSON output. Choose the surface for your team.

Python

Node.js

import requests
 
# Step 2: Define the API URL and the specific endpoint
API_URL = "https://api.twelvelabs.io/v1.3"
INDEXES_URL = f"{API_URL}/indexes"
 
# Step 3: Create the necessary headers for authentication
headers = {
    "x-api-key": "<YOUR_API_KEY>"
}
 
# Step 4: Prepare the data payload for your API request
INDEX_NAME = "<YOUR_INDEX_NAME>"
data = {
    "models": [
        {
            "model_name": "marengo3.0",
            "model_options": ["visual", "audio"]
        }
    ]
}

Quick Start

Index your first video and run a search in under 5 minutes.

Sample Apps

Production repos: video search, RAG over video, highlight reel generator, compliance scanner.

MCP Server

Connect Claude, Cursor, or any MCP client to your video index.

SDKs & API

Python, Node, REST. Full reference, typed responses, streaming.

Quick Start

Index your first video and run a search in under 5 minutes.

Sample Apps

Production repos: video search, RAG over video, highlight reel generator, compliance scanner.

MCP Server

Connect Claude, Cursor, or any MCP client to your video index.

SDKs & API

Python, Node, REST. Full reference, typed responses, streaming.

Built for video. Not for frames.

General-purpose multimodal LLMs handle video by sampling stills and creating captions. Pegasus processes the entire video—every frame, modality, and moment.

7,200s

Continuous video Pegasus handles in a single prompt — two full hours.