crawlora
Fetches structured public web data via the Crawlora REST API — search engines, e-commerce, social, finance, maps, app stores, media, and reviews — returning clean JSON instead of HTML. Use whenever the user needs real data from a public website (prices, listings, reviews, transcripts, SERPs, trends, financials, places) and would otherwise have to scrape or parse HTML. Skill: crawlora Owner: crawlora-org Summary: Fetches structured public web data via the Crawlora REST API — search engines, e-commerce, social, finance, maps, app stores, media, and reviews — returning clean JSON instead of HTML. Use whenever the user needs real data from a public website (prices, listings, reviews, transcripts, SERPs, trends, financials, places) and would otherwise have to scrape or parse HTML. Tags
Rank
62
Safety
84
Downloads
1.4k
Updated
Oct 10, 2026
Version
1.0.37
Source
CLAWHUB
About
What it does, and when to use it.
Capability contract not published. No trust telemetry is available yet. 1.4K downloads reported by the source. Last updated 10/10/2026.
Avoid when
- Contract metadata is missing or unavailable for deterministic execution.
Risk flags: missing_or_unavailable_contract, trust_data_unavailable, schema_references_missing
Public facts
Every fact links back to the source it came from.
- Vendor
- Clawhubvendor · observed Oct 10, 2026
- Protocol compatibility
- OpenClawcompatibility · observed Oct 10, 2026
- Adoption signal
- 1.4K downloadsadoption · observed Oct 10, 2026
- Latest release
- 1.0.37release · observed Oct 6, 2026
- Handshake status
- UNKNOWNsecurity
Install and run
Setup complexity: low.
clawhub skill install s17d53nb8nd03gyyfdy32rgde58e574f:crawlora- Setup complexity is classified as HIGH. You must provision dedicated cloud infrastructure or an isolated VM. Do not run this directly on your local workstation.
- Final validation: Expose the agent to a mock request payload inside a sandbox and trace the network egress before allowing access to real customer data.
Contract: missing
curl -s "https://www.xpersona.co/api/v1/agents/clawhub-crawlora-org-crawlora/snapshot"
Documentation
CLAWHUB
79,103 characters of source documentation, loaded on request.
Extracted files
3 files captured from the source.
SKILL.md
--- name: crawlora description: Fetches structured public web data via the Crawlora REST API — search engines, e-commerce, social, finance, maps, app stores, media, and reviews — returning clean JSON instead of HTML. Use whenever the user needs real data from a public website (prices, listings, reviews, transcripts, SERPs, trends, financials, places) and would otherwise have to scrape or parse HTML. --- # Crawlora — structured public web data Crawlora is a hosted API that turns public websites into clean, normalized JSON. The current public-data catalog contains **3,325 tools across 463 platform groups**, and the repository ships 165 installable research skills. One API key gives you the endpoints in the bundled [catalog](reference/catalog.md) — search engines, marketplaces, social and video, finance and crypto, maps, app stores, media, and reviews — so an agent can fetch real data without running a browser, proxies, or HTML parsers. Account usage, recent-IP, website-monitor management, generic URL scraping, APK analysis, and bulk profile-dataset endpoints are intentionally excluded from this skill. Dedicated skills cover the specialized workflows, and this helper rejects those paths as well. ## When to use this skill Use Crawlora when the user asks for live data that lives on a public website, e.g.: - "What's the price of X on Amazon / eBay / Shopify?" - "Pull the transcript / comments of this YouTube video." - "Get the latest Google / Bing results for …" or "what's trending on Google Trends?" - "Reviews and ratings for this iOS / Android app." - "Yahoo Finance quote / financials for NVDA", "top CoinGecko gainers". - "TikTok / Instagram / Reddit posts about …", "Trustpilot reviews for …". - Any task where the alternative would be scraping HTML or maintaining a crawler. Prefer a more specific Crawlora skill if one is installed (e.g. `product-price-research`, `youtube-research`, `app-review-mining`, `serp-keyword-research`). This umbrella skill covers everything else. ## Setup (one-time) - Get a free Crawlora API key (2,000 credits/mo, no card) at [https://crawlora.net](https://crawlora.net?utm_source=github&utm_medium=referral&utm_campaign=crawlora-skills). - Export it so the helper and any `curl` calls can read it: ```sh export CRAWLORA_API_KEY ``` Set `CRAWLORA_API_KEY` to the key you received before running the helper. - All requests go to `https://api.crawlora.net/api/v1` with the header `CRAWLORA_API_KEY` from the environment. A missing/invalid key returns `401`. ## How it works 1. **Pick the endpoint.** Open [`reference/catalog.md`](reference/catalog.md) — it lists every endpoint grouped by platform, with method, path, and parameters. Match the user's job to a platform group, then to an endpoint. 2. **Call it** with `scripts/crawlora.sh` (see below). It handles auth and prints JSON. 3. **Parse** the JSON with `jq` and answer. Most endpoints return paginated lists; pass `page`/`count` params where documented.
_meta.json
{
"ownerId": "kn70shhkf6qpfwgfrbgtep2wkd8c6b4t",
"slug": "crawlora",
"version": "1.0.37",
"publishedAt": 1791255000653
}skill-card.md
## Description: Fetches structured public web data through the Crawlora REST API as JSON across search, shopping, social, finance, maps, apps, media, and reviews. This skill is ready for commercial/non-commercial use. ## Publisher: [crawlora-org](https://clawhub.ai/user/crawlora-org) ### License/Terms of Use: MIT-0 ## Use Case: Developers and analysts use this skill to retrieve public web listings, search results, reviews, transcripts, trends, and market data without parsing website HTML. ### Deployment Geography for Use: Global ## Known Risks and Mitigations: Risk: Public-web queries, URLs, and locations are sent to Crawlora. Mitigation: Use only for public information; do not submit confidential internal data or personal secrets. Risk: The Crawlora API key could be exposed if handled carelessly. Mitigation: Keep CRAWLORA_API_KEY private in the environment; do not embed it in URLs or shared output. Risk: Public source websites may impose terms and rate limits. Mitigation: Respect each source site's terms and rate limits. ## Reference(s): - [Crawlora endpoint catalog](reference/catalog.md) - [Crawlora](https://crawlora.net) - [Crawlora skill on ClawHub](https://clawhub.ai/crawlora-org/skills/crawlora) ## Skill Output: **Output Type(s):** [JSON data, Text summaries, Shell commands] **Output Format:** [JSON responses and Markdown guidance with shell examples] **Output Parameters:** [1D] **Other Properties Related to Output:** [Requires a Crawlora API key; some results are paginated.] ## Skill Version(s): 1.0.37 (source: ClawHub release metadata) ## Ethical Considerations: Users should evaluate whether this skill is appropriate for their environment, review any generated or modified files before relying on them, and apply their organization's safety, security, and compliance requirements before deployment.
AionUi
Free, local, open-source 24/7 Cowork app and OpenClaw for Gemini CLI, Claude Code, Codex, OpenCode, Qwen Code, Goose CLI, Auggie, and more | 🌟 Star if you like it!
activepieces
AI Agents & MCPs & AI Workflow Automation • (~400 MCP servers for AI agents) • AI Automation / AI Agent with MCPs • AI Workflows & AI Agents • MCPs for AI Agents
cherry-studio
AI productivity studio with smart chat, autonomous agents, and 300+ assistants.
CopilotKit
The Frontend for Agents & Generative UI. React + Angular
Machine-readable data
The same record, as JSON, for agents and crawlers.
{
"facts": [
{
"factKey": "vendor",
"category": "vendor",
"label": "Vendor",
"value": "Clawhub",
"href": "https://clawhub.ai/crawlora-org/skills/crawlora",
"sourceUrl": "https://clawhub.ai/crawlora-org/skills/crawlora",
"sourceType": "profile",
"confidence": "medium",
"observedAt": "2026-10-10T14:27:33.305Z",
"isPublic": true
},
{
"factKey": "protocols",
"category": "compatibility",
"label": "Protocol compatibility",
"value": "OpenClaw",
"href": "https://www.xpersona.co/api/v1/agents/clawhub-crawlora-org-crawlora/contract",
"sourceUrl": "https://www.xpersona.co/api/v1/agents/clawhub-crawlora-org-crawlora/contract",
"sourceType": "contract",
"confidence": "medium",
"observedAt": "2026-10-10T14:27:33.305Z",
"isPublic": true
},
{
"factKey": "traction",
"category": "adoption",
"label": "Adoption signal",
"value": "1.4K downloads",
"href": "https://clawhub.ai/crawlora-org/crawlora",
"sourceUrl": "https://clawhub.ai/crawlora-org/crawlora",
"sourceType": "profile",
"confidence": "medium",
"observedAt": "2026-10-10T14:27:33.305Z",
"isPublic": true
},
{
"factKey": "latest_release",
"category": "release",
"label": "Latest release",
"value": "1.0.37",
"href": "https://clawhub.ai/crawlora-org/crawlora",
"sourceUrl": "https://clawhub.ai/crawlora-org/crawlora",
"sourceType": "release",
"confidence": "medium",
"observedAt": "2026-10-06T02:50:00.653Z",
"isPublic": true
},
{
"factKey": "handshake_status",
"category": "security",
"label": "Handshake status",
"value": "UNKNOWN",
"href": "https://www.xpersona.co/api/v1/agents/clawhub-crawlora-org-crawlora/trust",
"sourceUrl": "https://www.xpersona.co/api/v1/agents/clawhub-crawlora-org-crawlora/trust",
"sourceType": "trust",
"confidence": "medium",
"observedAt": null,
"isPublic": true
}
],
"events": [
{
"eventType": "release",
"title": "Release 1.0.37",
"description": "Correct umbrella inventory to 165 installable skills",
"href": "https://clawhub.ai/crawlora-org/crawlora",
"sourceUrl": "https://clawhub.ai/crawlora-org/crawlora",
"sourceType": "release",
"confidence": "medium",
"observedAt": "2026-10-06T02:50:00.653Z",
"isPublic": true
}
]
}Record generated Oct 10, 2026.
