Remotion 逐词高亮字幕
用 Whisper 逐词时间戳和 Remotion 给视频加当前词高亮字幕。 Skill: Remotion 逐词高亮字幕 Owner: 0x00000003 Summary: 用 Whisper 逐词时间戳和 Remotion 给视频加当前词高亮字幕。 Tags: latest:0.1.4, remotion:0.1.4, short-video:0.1.4, subtitles:0.1.4, video:0.1.4, whisper:0.1.4 Version history: v0.1.4 | 2026-05-14T12:53:13.796Z | user Enforce larger subtitle sizing and strip display punctuation by default. v0.1.3 | 2026-05-03T16:42:58.642Z | user Make transcript QA mandatory before rendering; add cross-tok
Rank
62
Safety
84
Downloads
987
Updated
Oct 11, 2026
Version
0.1.4
Source
CLAWHUB
About
What it does, and when to use it.
Capability contract not published. No trust telemetry is available yet. 987 downloads reported by the source. Last updated 10/11/2026.
Avoid when
- Contract metadata is missing or unavailable for deterministic execution.
Risk flags: missing_or_unavailable_contract, trust_data_unavailable, schema_references_missing
Public facts
Every fact links back to the source it came from.
- Vendor
- Clawhubvendor · observed Oct 11, 2026
- Protocol compatibility
- OpenClawcompatibility · observed Oct 11, 2026
- Adoption signal
- 987 downloadsadoption · observed Oct 11, 2026
- Latest release
- 0.1.4release · observed May 14, 2026
- Handshake status
- UNKNOWNsecurity
What changed
Newest first. Only changes that point at a source are listed.
Release 0.1.4release
Enforce larger subtitle sizing and strip display punctuation by default.
Observed May 14, 2026 · source
Install and run
Setup complexity: low.
clawhub skill install s170qhqbpmn4wvbe5p927d7hd183mmwq:remotion-word-highlight-subtitles- Setup complexity is LOW. This package is likely designed for quick installation with minimal external side-effects.
- Final validation: Expose the agent to a mock request payload inside a sandbox and trace the network egress before allowing access to real customer data.
Contract: missing
curl -s "https://www.xpersona.co/api/v1/agents/clawhub-0x00000003-remotion-word-highlight-subtitles/snapshot"
Run-check
$0.02 USD1 measured facts are behind this paywall: success rate and latency, uptime and estimated cost, when not to use it, how to call it, benchmark scores.
Agents pay $0.02 in USDC. A card payment is $0.50, the smallest a card allows.
Documentation
CLAWHUB
71,861 characters of source documentation, loaded on request.
Extracted files
5 files captured from the source.
SKILL.md
---
name: remotion-word-highlight-subtitles
description: Add word-level highlighted subtitles to local short videos using Whisper word timestamps and Remotion rendering.
version: 0.1.4
metadata:
openclaw:
requires:
bins:
- python3
- ffmpeg
- ffprobe
- whisper
- node
- npm
emoji: "🎬"
---
# Remotion Word Highlight Subtitles
## Overview
This skill turns a local video into a subtitled video using the reusable "fine version": Whisper word timestamps plus Remotion-rendered current-word highlighting. Use this instead of plain SRT burn-in unless the user explicitly asks for simple static subtitles.
Detailed usage guide, README, and effect preview: https://github.com/0x00000003/remotion-word-highlight-subtitles
## Trigger Phrases
Use this skill for requests like:
- "给这个视频添加字幕:/path/to/video.mp4"
- "给这个视频加逐词高亮字幕"
- "按之前 Remotion 那个字幕方案处理这个视频"
- "重新转写 word timestamps,然后加当前词高亮字幕"
If the user only gives one video path, write the output next to the source video.
## Defaults
- Source: local `.mp4`, `.mov`, `.m4v`, or audio/video file with usable audio.
- Output: `<source-stem>_remotion逐词高亮字幕.mp4` in the same directory unless the user names another target.
- Transcription: Whisper with word timestamps, Chinese by default: `--language zh --word_timestamps True --output_format json`.
- Transcript QA: mandatory before rendering. Build a tiny glossary from the user prompt, folder/file names, visible context, and topic; correct obvious ASR mistakes in product/model/person/place names, English terms, numbers, and homophones.
- Caption data: Remotion caption chunks built from Whisper words, with token-level `startMs` and `endMs`. Long Whisper segments must be split by punctuation, timing gaps, duration, or length before rendering.
- Caption position: keep all captions in a screenshot-friendly lower band, slightly above the bottom UI area. Start around `height * 0.28` bottom padding, then adjust only if the source framing clearly needs it.
- Visual style: bold Chinese UI font, white base text, current token yellow, optional sparse keyword accent, and black shadow/outline for readability.
- Subtitle sizing: treat font size as a hard visual gate, not a loose style hint. For landscape 1080p footage, target `height * 0.056` (about `60px`) and never render below `56px`; for vertical `720x1280`, target `40-46px`. For other sizes, scale from height but enforce the same perceived size in still QA.
- Display punctuation: default subtitles are clean Chinese display text. Strip visible sentence punctuation from caption text and token text before rendering, including `。 , 、 ? ! : ; , . ? ! : ;`. Keep punctuation only for splitting/timing unless the user explicitly asks for verbatim punctuation.
- Verification: check the rendered file exists, keeps audio, matches the source duration closely, and visually inspect stills before accepting the style.
## Workflow
1. Inspect the source with `ffprobe` for width, hREADME.md
# Remotion Word Highlight Subtitles
Use Whisper word timestamps and Remotion to add short-video subtitles where the word currently being spoken is highlighted.
This Skill is designed for Chinese creator workflows where subtitles need to feel polished, readable, and screenshot-friendly.

## What It Does
- Transcribes a local video with Whisper `word_timestamps`.
- Converts Whisper's word-level JSON into Remotion-friendly `captions.json`.
- Splits long Whisper paragraphs into readable caption chunks.
- Requires a transcript QA pass before rendering so obvious ASR mistakes can be corrected.
- Renders subtitles with Remotion instead of burning plain SRT text.
- Highlights the current spoken word in yellow.
- Optionally marks sparse keywords with a secondary accent.
- Strips visible display punctuation by default while still using punctuation for caption splitting.
- Enforces orientation-aware subtitle size floors so landscape subtitles do not render too small.
- Keeps subtitles in a lower, screenshot-friendly band by default.
- Writes the rendered video next to the source file.
Default output name:
```text
<source-stem>_remotion逐词高亮字幕.mp4
```
## Installation
Install from ClawHub:
```bash
clawhub install remotion-word-highlight-subtitles
```
Then restart or reload your OpenClaw/Codex environment if your agent does not discover new skills immediately.
## Example Prompts
Use natural prompts like:
```text
给这个视频添加逐词高亮字幕:/absolute/path/to/video.mp4
```
```text
按 Remotion 逐词高亮字幕方案,给这个视频加字幕:/absolute/path/to/video.mp4
```
```text
重新转写 word timestamps,然后给这个视频加当前词高亮字幕:/absolute/path/to/video.mp4
```
The agent should then follow the Skill workflow: inspect the video, transcribe with Whisper, prepare caption JSON, render with Remotion, and verify the output.
## Requirements
The workflow expects these tools to be available locally:
- `python3`
- `ffmpeg`
- `ffprobe`
- `whisper`
- `node`
- `npm`
- Remotion dependencies in the generated or reused Remotion project
The Skill does not upload your video anywhere by itself. It is intended for local video files and local rendering.
## Workflow Summary
1. Read source video metadata with `ffprobe`.
2. Run Whisper with word-level timestamps:
```bash
whisper "/absolute/path/video.mp4" \
--model turbo \
--language zh \
--word_timestamps True \
--output_format json \
--output_dir "/absolute/path/output-dir"
```
3. Review the Whisper transcript before rendering. Build a correction map for obvious mistakes in names, model versions, English terms, numbers, and homophones.
4. Convert Whisper JSON to Remotion caption data:
```bash
python3 scripts/whisper_json_to_captions.py \
"/absolute/path/transcript.json" \
"/absolute/path/remotion-project/public/captions.json" \
--replace-phrase "错识别词=正确词" \
--_meta.json
{
"ownerId": "kn72xxfk73vbpw9t4yzms3ma5581mwqp",
"slug": "remotion-word-highlight-subtitles",
"version": "0.1.4",
"publishedAt": 1778763193796
}skill-card.md
## Description: Add word-level highlighted subtitles to local short videos using Whisper word timestamps and Remotion rendering. This skill is ready for commercial/non-commercial use. ## Publisher: [0x00000003](https://clawhub.ai/user/0x00000003) ### License/Terms of Use: MIT-0 ## Use Case: Developers, video creators, and agent users use this skill to transcribe local short videos, review and correct word-level captions, and render polished Chinese-oriented subtitles with current-word highlighting. ### Deployment Geography for Use: Global ## Known Risks and Mitigations: Risk: The workflow processes local media and writes rendered outputs, so users could choose the wrong input or output location. Mitigation: Use only video files and output folders selected by the user, and keep the generated video separate from the source file. Risk: The default Whisper settings are optimized for Chinese-language subtitles and may produce inaccurate captions for other languages. Mitigation: Change the Whisper language option for non-Chinese videos and complete the transcript QA pass before rendering. Risk: Missing or mismatched local rendering tools can cause failed renders, lost audio, or duration mismatches. Mitigation: Verify python3, ffmpeg, ffprobe, whisper, node, npm, and Remotion dependencies, then inspect stills and check final duration and audio with ffprobe. ## Reference(s): - [ClawHub skill page](https://clawhub.ai/0x00000003/skills/remotion-word-highlight-subtitles) - [Project documentation linked by skill](https://github.com/0x00000003/remotion-word-highlight-subtitles) - [Word highlight subtitle example image](https://raw.githubusercontent.com/0x00000003/remotion-word-highlight-subtitles/main/assets/effect-word-highlight.jpg) ## Skill Output: **Output Type(s):** [text, markdown, code, shell commands, configuration, guidance, files] **Output Format:** [Markdown guidance with shell commands, code snippets, and JSON caption data] **Output Parameters:** [1D] **Other Properties Related to Output:** [Produces Remotion caption JSON and guidance for rendering a local MP4 subtitle output; expects local python3, ffmpeg, ffprobe, whisper, node, and npm.] ## Skill Version(s): 0.1.4 (source: frontmatter and server release) ## Ethical Considerations: Users should evaluate whether this skill is appropriate for their environment, review any generated or modified files before relying on them, and apply their organization's safety, security, and compliance requirements before deployment.
agents/openai.yaml
interface: display_name: "Remotion 逐词高亮字幕" short_description: "用 Whisper 逐词时间戳和 Remotion 给视频加当前词高亮字幕。" default_prompt: "给这个视频添加逐词高亮字幕:"
AionUi
Free, local, open-source 24/7 Cowork app and OpenClaw for Gemini CLI, Claude Code, Codex, OpenCode, Qwen Code, Goose CLI, Auggie, and more | 🌟 Star if you like it!
activepieces
AI Agents & MCPs & AI Workflow Automation • (~400 MCP servers for AI agents) • AI Automation / AI Agent with MCPs • AI Workflows & AI Agents • MCPs for AI Agents
cherry-studio
AI productivity studio with smart chat, autonomous agents, and 300+ assistants.
CopilotKit
The Frontend for Agents & Generative UI. React + Angular
Machine-readable data
The same record, as JSON, for agents and crawlers.
- Card JSON
- Facts JSON
- Snapshot JSON
- Contract JSON
- Trust JSON
- Changes JSON
- Warnings JSON
- Seen by JSON
- Disagreements JSON
{
"facts": [
{
"factKey": "vendor",
"category": "vendor",
"label": "Vendor",
"value": "Clawhub",
"href": "https://clawhub.ai/0x00000003/skills/remotion-word-highlight-subtitles",
"sourceUrl": "https://clawhub.ai/0x00000003/skills/remotion-word-highlight-subtitles",
"sourceType": "profile",
"confidence": "medium",
"observedAt": "2026-10-11T22:06:48.033Z",
"isPublic": true
},
{
"factKey": "protocols",
"category": "compatibility",
"label": "Protocol compatibility",
"value": "OpenClaw",
"href": "https://www.xpersona.co/api/v1/agents/clawhub-0x00000003-remotion-word-highlight-subtitles/contract",
"sourceUrl": "https://www.xpersona.co/api/v1/agents/clawhub-0x00000003-remotion-word-highlight-subtitles/contract",
"sourceType": "contract",
"confidence": "medium",
"observedAt": "2026-10-11T22:06:48.033Z",
"isPublic": true
},
{
"factKey": "traction",
"category": "adoption",
"label": "Adoption signal",
"value": "987 downloads",
"href": "https://clawhub.ai/0x00000003/remotion-word-highlight-subtitles",
"sourceUrl": "https://clawhub.ai/0x00000003/remotion-word-highlight-subtitles",
"sourceType": "profile",
"confidence": "medium",
"observedAt": "2026-10-11T22:06:48.033Z",
"isPublic": true
},
{
"factKey": "latest_release",
"category": "release",
"label": "Latest release",
"value": "0.1.4",
"href": "https://clawhub.ai/0x00000003/remotion-word-highlight-subtitles",
"sourceUrl": "https://clawhub.ai/0x00000003/remotion-word-highlight-subtitles",
"sourceType": "release",
"confidence": "medium",
"observedAt": "2026-05-14T12:53:13.796Z",
"isPublic": true
},
{
"factKey": "handshake_status",
"category": "security",
"label": "Handshake status",
"value": "UNKNOWN",
"href": "https://www.xpersona.co/api/v1/agents/clawhub-0x00000003-remotion-word-highlight-subtitles/trust",
"sourceUrl": "https://www.xpersona.co/api/v1/agents/clawhub-0x00000003-remotion-word-highlight-subtitles/trust",
"sourceType": "trust",
"confidence": "medium",
"observedAt": null,
"isPublic": true
}
],
"events": [
{
"eventType": "release",
"title": "Release 0.1.4",
"description": "Enforce larger subtitle sizing and strip display punctuation by default.",
"href": "https://clawhub.ai/0x00000003/remotion-word-highlight-subtitles",
"sourceUrl": "https://clawhub.ai/0x00000003/remotion-word-highlight-subtitles",
"sourceType": "release",
"confidence": "medium",
"observedAt": "2026-05-14T12:53:13.796Z",
"isPublic": true
}
]
}Record generated Oct 12, 2026.
For crawlers
This page is free to read. The run-check above is the only paid part, and it answers HTTP 402 until it is paid. Everything else here is public.
- One record, as JSON: card, facts, snapshot, contract, trust, changes, warnings, seen by, disagreements.
- Every agent, one feed: /.well-known/ai-catalog.json
- What this site sells, and the price: /.well-known/x402
- Paid run-check: /api/v1/agents/clawhub-0x00000003-remotion-word-highlight-subtitles/run-check
