SkillsAdd

calesthio/openmontage

video-understand

Understand video content locally using ffmpeg frame extraction and Whisper transcription. No API keys needed. Use when: (1) Understanding what a video contains, (2) Transcribing video audio locally, (3) Extracting key frames for visual analysis, (4) Getting video content without API keys.

First seen Apr 4, 2026

Installation

$ npx skills add calesthio/openmontage --skill video-understand
View on skills.sh ↗ GitHub repository ↗

Similar popular skills

Related neighbors and high-traction skills in the same topics — useful to compare before installing.

understand Similar name
egonex-ai/understand-anything

Analyze a codebase to produce an interactive knowledge graph for understanding architecture, co…

3.8K installs
understand-dashboard Similar name
egonex-ai/understand-anything

Launch the interactive web dashboard to visualize a codebase's knowledge graph

2.8K installs
understand-explain Similar name
egonex-ai/understand-anything

Use when you need a deep-dive explanation of a specific file, function, or module in the codeba…

2.8K installs
understand-chat Similar name
egonex-ai/understand-anything

Use when you need to ask questions about a codebase or understand code using a knowledge graph

2.7K installs
understand-onboard Similar name
egonex-ai/understand-anything

Use when you need to generate an onboarding guide for new team members joining a project

2.7K installs
understand-diff Similar name
egonex-ai/understand-anything

Use when you need to analyze git diffs or pull requests to understand what changed, affected co…

2.6K installs

Also in this package

Other skills from calesthio/openmontage · top by installs.

npx skills add calesthio/openmontage
video-edit 9 ai-video-gen 7 video-download 7 remotion 7 text-to-speech 7 svg-character-animation 7 seedance-2-0 7 ffmpeg 8 video-toolkit 7 visual-style 8

Browse all from calesthio/openmontage

More details

Agent compatibility

Declared targets from SKILL.md / docs. Unmarked agents are not listed — the skill may still install via the CLI.

Claude Code Not declared
Cursor Not declared
Codex Not declared
GitHub Copilot Not declared
Windsurf Not declared
Gemini CLI Not declared
Cline Not declared
OpenCode Not declared

Repository health

Stars 56.6K
License LICENSE
Default branch main
Open issues 96
Status Active

Package contents

Files included with this skill beyond the listing page.

  • skill md SKILL.md 3,363 B
  • docs SUMMARY.md 3,283 B

History

  1. First seen on skills.sh
  2. First recorded snapshot · 852 installs

SKILL.md

video-understand

Understand video content locally using ffmpeg for frame extraction and Whisper for transcription. Fully offline, no API keys required.

Prerequisites

  • ffmpeg + ffprobe (required): brew install ffmpeg
  • openai-whisper (optional, for transcription): pip install openai-whisper

Commands

# Scene detection + transcribe (default)
python3 skills/video-understand/scripts/understand_video.py video.mp4

# Keyframe extraction
python3 skills/video-understand/scripts/understand_video.py video.mp4 -m keyframe

# Regular interval extraction
python3 skills/video-understand/scripts/understand_video.py video.mp4 -m interval

# Limit frames extracted
python3 skills/video-understand/scripts/understand_video.py video.mp4 --max-frames 10

# Use a larger Whisper model
python3 skills/video-understand/scripts/understand_video.py video.mp4 --whisper-model small

# Frames only, skip transcription
python3 skills/video-understand/scripts/understand_video.py video.mp4 --no-transcribe

# Quiet mode (JSON only, no progress)
python3 skills/video-understand/scripts/understand_video.py video.mp4 -q

# Output to file
python3 skills/video-understand/scripts/understand_video.py video.mp4 -o result.json

CLI Options

Flag Description
video Input video file (positional, required)
-m, --mode Extraction mode: scene (default), keyframe, interval
--max-frames Maximum frames to keep (default: 20)
--whisper-model Whisper model size: tiny, base, small, medium, large (default: base)
--no-transcribe Skip audio transcription, extract frames only
-o, --output Write result JSON to file instead of stdout
-q, --quiet Suppress progress messages, output only JSON

Extraction Modes

Mode How it works Best for
scene Detects scene changes via ffmpeg select='gt(scene,0.3)' Most videos, varied content
keyframe Extracts I-frames (codec keyframes) Encoded video with natural keyframe placement
interval Evenly spaced frames based on duration and max-frames Fixed sampling, predictable output

If scene mode detects no scene changes, it automatically falls back to interval mode.

Output

The script outputs JSON to stdout (or file with -o). See references/output-format.md for the full schema.

{
  "video": "video.mp4",
  "duration": 18.076,
  "resolution": {"width": 1224, "height": 1080},
  "mode": "scene",
  "frames": [
    {"path": "/abs/path/frame_0001.jpg", "timestamp": 0.0, "timestamp_formatted": "00:00"}
  ],
  "frame_count": 12,
  "transcript": [
    {"start": 0.0, "end": 2.5, "text": "Hello and welcome..."}
  ],
  "text": "Full transcript...",
  "note": "Use the Read tool to view frame images for visual understanding."
}

Use the Read tool on frame image paths to visually inspect extracted frames.

References

  • references/output-format.md -- Full JSON output schema documentation