Video Context MCP
The video MCP server
for AI agents.
The Video Context MCP server is a remote Model Context Protocol server that lets AI agents such as Claude, ChatGPT, Cursor, and Codex understand, search, and edit video through tool calls.
Endpoint: https://mcp.videocontextapi.com/mcp · Transport: Streamable HTTP · Auth: bearer key
Tools in the Video Context MCP server
Each tool returns timestamped JSON in one schema, so your agent can read the result and decide the next step.
understand_video
Index a video from a URL and return its context: scenes, shots, transcript, on-screen text, objects, and summary.
search_moments
Search one video or a whole index in natural language. Returns moments with start, end, and confidence.
query_segments
Filter the segments of a catalog by type, labels, objects, speakers, and time.
create_edit
Give an editing tool the context for a goal in plain language: scenes, pauses, speakers, and key moments, as timeline JSON.
extract_template
Turn a video into a reusable template of sections, timing, and slots.
extract_style
Measure the style of a video: pacing, cut rhythm, captions, colour, and framing.
Connect Video Context to your MCP client
Replace YOUR_BETA_KEY with the key that you get after your beta call. The server accepts beta keys only.
claude mcp add --transport http video-context https://mcp.videocontextapi.com/mcp \ --header "Authorization: Bearer YOUR_BETA_KEY"
{
"mcpServers": {
"video-context": {
"type": "http",
"url": "https://mcp.videocontextapi.com/mcp",
"headers": {
"Authorization": "Bearer YOUR_BETA_KEY"
}
}
}
}{
"mcpServers": {
"video-context": {
"type": "http",
"url": "https://mcp.videocontextapi.com/mcp",
"headers": {
"Authorization": "Bearer YOUR_BETA_KEY"
}
}
}
}{
"servers": {
"video-context": {
"type": "http",
"url": "https://mcp.videocontextapi.com/mcp",
"headers": {
"Authorization": "Bearer YOUR_BETA_KEY"
}
}
}
}[mcp_servers.video-context] url = "https://mcp.videocontextapi.com/mcp" bearer_token_env_var = "VIDEO_CONTEXT_API_KEY"
{
"tool": "search_moments",
"arguments": {
"video_url": "https://example.com/keynote.mp4",
"query": "the speaker shows the pricing slide"
}
}{
"moments": [
{
"start": 1284.2,
"end": 1311.8,
"confidence": 0.91,
"summary": "The speaker presents a slide with three pricing tiers.",
"evidence": ["on_screen_text: Starter, Pro, Enterprise", "transcript: here is how pricing works"]
}
]
}This is the planned tool design. Beta partners help set the final design of each tool.
What you can ask your agent
- “Find every moment in this keynote where the speaker talks about pricing.”
- “Summarise this 40-minute interview, with a timestamp for each topic.”
- “List the products that appear on screen in this ad, and when they appear.”
- “Cut this webinar into three 30-second clips about the new feature.”
- “Check this upload for logos, faces, and on-screen text before we publish it.”
Free and open source today
Video tools MCP: a local video MCP server
An MCP server that gives AI agents local FFmpeg video tools: metadata, shot detection, frame extraction, and keyframe checks. No API key.
claude mcp add video-tools -- npx -y github:video-context/video-tools-mcp
Set up Video Context with a coding agent in one line: see Video Context for agents and agents.md.
FAQ
Questions, answered.
Short answers about the Video Context MCP server.
What is the Video Context MCP server?+
The Video Context MCP server is a remote Model Context Protocol server that lets AI agents such as Claude, ChatGPT, Cursor, and Codex understand, search, and edit video through tool calls. It returns scenes, shots, a transcript, on-screen text, objects, and moments with start and end times, in one JSON schema.
How do I connect the Video Context MCP server?+
Add the endpoint https://mcp.videocontextapi.com/mcp to your MCP client, with your beta key as a bearer token. The page has the config for Claude Code, Claude Desktop, Cursor, VS Code, and Codex.
Is the Video Context MCP server free?+
The hosted server is in private beta. Beta partners get a key after a 30-minute call. The local server, Video tools MCP, is free and open source today, and it needs no key.
Which AI models does the Video Context MCP server use?+
Video Context is model-agnostic. It routes each job to the best model for the task, and it gives your agent the same schema when the models change.
Which MCP clients work with Video Context?+
Any client that supports remote MCP servers over HTTP: Claude Code, Claude Desktop, ChatGPT, Cursor, VS Code, Codex, Windsurf, and others.
What is the difference between the hosted server and the local server?+
The local server runs FFmpeg on your computer. It reads metadata, finds shots, extracts frames, and checks keyframes. The hosted server adds speech, on-screen text, objects, semantic search, and whole catalogs.
Your videos contain
valuable data.
Start using it.
Analyse video at scale. Find exactly what you need. Give your products and AI the context to act on it.