Extract
Extract content from specific URLs using Tavily's extraction API. Returns clean markdown/text from web pages. Use when you have specific URLs and need their content without writing code. Skill: Extract Owner: barneyjm Summary: Extract content from specific URLs using Tavily's extraction API. Returns clean markdown/text from web pages. Use when you have specific URLs and need their content without writing code. Tags: latest:0.1.0 Version history: v0.1.0 | 2026-02-03T15:26:48.236Z | auto - Initial release of the extract skill for obtaining clean content from web pages via Tavily's extraction API. - Sup
Rank
62
Safety
84
Downloads
2.1k
Updated
Oct 9, 2026
Version
0.1.0
Source
CLAWHUB
About
What it does, and when to use it.
Capability contract not published. No trust telemetry is available yet. 2.1K downloads reported by the source. Last updated 10/9/2026.
Avoid when
- Contract metadata is missing or unavailable for deterministic execution.
Risk flags: missing_or_unavailable_contract, trust_data_unavailable, schema_references_missing
Public facts
Every fact links back to the source it came from.
- Vendor
- Clawhubvendor · observed Oct 9, 2026
- Protocol compatibility
- OpenClawcompatibility · observed Oct 9, 2026
- Adoption signal
- 2.1K downloadsadoption · observed Oct 9, 2026
- Latest release
- 0.1.0release · observed Feb 3, 2026
- Handshake status
- UNKNOWNsecurity
Install and run
Setup complexity: low.
clawhub skill install s175g00ed7n2ej0r13jbm8m3k18842ww:extract- Setup complexity is LOW. This package is likely designed for quick installation with minimal external side-effects.
- Final validation: Expose the agent to a mock request payload inside a sandbox and trace the network egress before allowing access to real customer data.
Contract: missing
curl -s "https://www.xpersona.co/api/v1/agents/clawhub-barneyjm-extract/snapshot"
Documentation
CLAWHUB
5,857 characters of source documentation, loaded on request.
Extracted files
2 files captured from the source.
SKILL.md
---
name: extract
description: "Extract content from specific URLs using Tavily's extraction API. Returns clean markdown/text from web pages. Use when you have specific URLs and need their content without writing code."
---
# Extract Skill
Extract clean content from specific URLs. Ideal when you know which pages you want content from.
## Prerequisites
**Tavily API Key Required** - Get your key at https://tavily.com
Add to `~/.claude/settings.json`:
```json
{
"env": {
"TAVILY_API_KEY": "tvly-your-api-key-here"
}
}
```
## Quick Start
### Using the Script
```bash
./scripts/extract.sh '<json>'
```
**Examples:**
```bash
# Single URL
./scripts/extract.sh '{"urls": ["https://example.com/article"]}'
# Multiple URLs
./scripts/extract.sh '{"urls": ["https://example.com/page1", "https://example.com/page2"]}'
# With query focus and chunks
./scripts/extract.sh '{"urls": ["https://example.com/docs"], "query": "authentication API", "chunks_per_source": 3}'
# Advanced extraction for JS pages
./scripts/extract.sh '{"urls": ["https://app.example.com"], "extract_depth": "advanced", "timeout": 60}'
```
### Basic Extraction
```bash
curl --request POST \
--url https://api.tavily.com/extract \
--header "Authorization: Bearer $TAVILY_API_KEY" \
--header 'Content-Type: application/json' \
--data '{
"urls": ["https://example.com/article"]
}'
```
### Multiple URLs with Query Focus
```bash
curl --request POST \
--url https://api.tavily.com/extract \
--header "Authorization: Bearer $TAVILY_API_KEY" \
--header 'Content-Type: application/json' \
--data '{
"urls": [
"https://example.com/ml-healthcare",
"https://example.com/ai-diagnostics"
],
"query": "AI diagnostic tools accuracy",
"chunks_per_source": 3
}'
```
## API Reference
### Endpoint
```
POST https://api.tavily.com/extract
```
### Headers
| Header | Value |
|--------|-------|
| `Authorization` | `Bearer <TAVILY_API_KEY>` |
| `Content-Type` | `application/json` |
### Request Body
| Field | Type | Default | Description |
|-------|------|---------|-------------|
| `urls` | array | Required | URLs to extract (max 20) |
| `query` | string | null | Reranks chunks by relevance |
| `chunks_per_source` | integer | 3 | Chunks per URL (1-5, requires query) |
| `extract_depth` | string | `"basic"` | `basic` or `advanced` (for JS pages) |
| `format` | string | `"markdown"` | `markdown` or `text` |
| `include_images` | boolean | false | Include image URLs |
| `timeout` | float | varies | Max wait (1-60 seconds) |
### Response Format
```json
{
"results": [
{
"url": "https://example.com/article",
"raw_content": "# Article Title\n\nContent..."
}
],
"failed_results": [],
"response_time": 2.3
}
```
## Extract Depth
| Depth | When to Use |
|-------|-------------|
| `basic` | Simple text extraction, faster |
| `advanced` | Dynamic/JS-rendered pages, tables, structured data |
## Examples
### Single URL Extraction
```bash
curl _meta.json
{
"ownerId": "kn7e3j3w1x5et0yppacy4m90y18084ba",
"slug": "extract",
"version": "0.1.0",
"publishedAt": 1770132408236
}AionUi
Free, local, open-source 24/7 Cowork app and OpenClaw for Gemini CLI, Claude Code, Codex, OpenCode, Qwen Code, Goose CLI, Auggie, and more | 🌟 Star if you like it!
activepieces
AI Agents & MCPs & AI Workflow Automation • (~400 MCP servers for AI agents) • AI Automation / AI Agent with MCPs • AI Workflows & AI Agents • MCPs for AI Agents
cherry-studio
AI productivity studio with smart chat, autonomous agents, and 300+ assistants.
CopilotKit
The Frontend for Agents & Generative UI. React + Angular
Machine-readable data
The same record, as JSON, for agents and crawlers.
{
"facts": [
{
"factKey": "vendor",
"category": "vendor",
"label": "Vendor",
"value": "Clawhub",
"href": "https://clawhub.ai/barneyjm/skills/extract",
"sourceUrl": "https://clawhub.ai/barneyjm/skills/extract",
"sourceType": "profile",
"confidence": "medium",
"observedAt": "2026-10-09T18:17:10.502Z",
"isPublic": true
},
{
"factKey": "protocols",
"category": "compatibility",
"label": "Protocol compatibility",
"value": "OpenClaw",
"href": "https://www.xpersona.co/api/v1/agents/clawhub-barneyjm-extract/contract",
"sourceUrl": "https://www.xpersona.co/api/v1/agents/clawhub-barneyjm-extract/contract",
"sourceType": "contract",
"confidence": "medium",
"observedAt": "2026-10-09T18:17:10.502Z",
"isPublic": true
},
{
"factKey": "traction",
"category": "adoption",
"label": "Adoption signal",
"value": "2.1K downloads",
"href": "https://clawhub.ai/barneyjm/extract",
"sourceUrl": "https://clawhub.ai/barneyjm/extract",
"sourceType": "profile",
"confidence": "medium",
"observedAt": "2026-10-09T18:17:10.502Z",
"isPublic": true
},
{
"factKey": "latest_release",
"category": "release",
"label": "Latest release",
"value": "0.1.0",
"href": "https://clawhub.ai/barneyjm/extract",
"sourceUrl": "https://clawhub.ai/barneyjm/extract",
"sourceType": "release",
"confidence": "medium",
"observedAt": "2026-02-03T15:26:48.236Z",
"isPublic": true
},
{
"factKey": "handshake_status",
"category": "security",
"label": "Handshake status",
"value": "UNKNOWN",
"href": "https://www.xpersona.co/api/v1/agents/clawhub-barneyjm-extract/trust",
"sourceUrl": "https://www.xpersona.co/api/v1/agents/clawhub-barneyjm-extract/trust",
"sourceType": "trust",
"confidence": "medium",
"observedAt": null,
"isPublic": true
}
],
"events": [
{
"eventType": "release",
"title": "Release 0.1.0",
"description": "- Initial release of the extract skill for obtaining clean content from web pages via Tavily's extraction API. - Supports extracting from up to 20 URLs per request, with options for focus queries, chunk sizing, extraction depth, and output format. - Provides examples and detailed instructions for command-line and API usage. - Includes support for advanced extraction on JavaScript-heavy or dynamic pages. - Guides on common pitfalls, batching, and troubleshooting with failed URL results.",
"href": "https://clawhub.ai/barneyjm/extract",
"sourceUrl": "https://clawhub.ai/barneyjm/extract",
"sourceType": "release",
"confidence": "medium",
"observedAt": "2026-02-03T15:26:48.236Z",
"isPublic": true
}
]
}Record generated Oct 10, 2026.
