Crawler Summary

πŸ₯· ShadowCrawl: The Zero-Docker "Unstoppable" Stealth Scraper & Search answer-first brief

**Pure Rust MCP Server** ShadowCrawl is a high-performance, Zero-Docker MCP server written in Rust. It serves as a 100% private, sovereign alternative to Firecrawl, Jina Reader, and Tavily. Unlike other scrapers, ShadowCrawl v2.3.0 runs as a single standalone binary with native Chromium control (CDP) and a Human-In-The-Loop (HITL) fallback system, ensuring you can bypass 99.9% of bot protections (Cloudflare, DataDome) without complex infrastructure. Why AI Agents love ShadowCrawl: - Zero-Docker & Zero-Config: No Redis, No Qdrant, No SearXNG. Single binary setup. - God-Tier Anti-Bot Bypass: Native Chromiumoxide (CDP) with JS-level stealth injection and HITL (Human-In-The-Loop) fallback for solving CAPTCHAs. - Internal Meta-Search: Parallel search across Google, Bing, DuckDuckGo, and Brave without external API keys. - Smart Ad-Blocking: Built-in high-speed aho-corasick engine to strip ads and trackers before extraction. - Semantic Memory: Embedded LanceDB for 100% local, private research history recall. - AI-Optimized Markdown: Delivers ultra-clean content stripped of "Buddhist Era" dates and web noise. Tools list: search_web β€” federated search (No API Key needed) search_structured β€” search + top result scraping scrape_url β€” single URL extraction scrape_batch β€” multi-URL parallel scraping crawl_website β€” bounded recursive crawling extract_structured β€” schema-driven extraction research_history β€” semantic recall from prior runs proxy_manager β€” proxy list/status/switch/test/grab operations non_robot_search β€” [NEW] The "Nuclear Option" for Boss-level anti-bots (LinkedIn/Cloudflare) with HITL. **Pure Rust MCP Server** ShadowCrawl is a high-performance, Zero-Docker MCP server written in Rust. It serves as a 100% private, sovereign alternative to Firecrawl, Jina Reader, and Tavily. Unlike other scrapers, ShadowCrawl v2.3.0 runs as a single standalone binary with native Chromium control (CDP) and a Human-In-The-Loop (HITL) fallback system, ensuring you can bypass 99.9% of bot protections (Cloudflare, DataDome Capability contract not published. No trust telemetry is available yet. Last updated 4/15/2026.

Freshness

Last checked 4/15/2026

Best For

πŸ₯· ShadowCrawl: The Zero-Docker "Unstoppable" Stealth Scraper & Search is best for general automation workflows where MCP compatibility matters.

Not Ideal For

Contract metadata is missing or unavailable for deterministic execution.

Evidence Sources Checked

editorial-content, Smithery, runtime-metrics, public facts pack

Claim this agent
Agent DossierSmitherySafety: 86/100

πŸ₯· ShadowCrawl: The Zero-Docker "Unstoppable" Stealth Scraper & Search

**Pure Rust MCP Server** ShadowCrawl is a high-performance, Zero-Docker MCP server written in Rust. It serves as a 100% private, sovereign alternative to Firecrawl, Jina Reader, and Tavily. Unlike other scrapers, ShadowCrawl v2.3.0 runs as a single standalone binary with native Chromium control (CDP) and a Human-In-The-Loop (HITL) fallback system, ensuring you can bypass 99.9% of bot protections (Cloudflare, DataDome) without complex infrastructure. Why AI Agents love ShadowCrawl: - Zero-Docker & Zero-Config: No Redis, No Qdrant, No SearXNG. Single binary setup. - God-Tier Anti-Bot Bypass: Native Chromiumoxide (CDP) with JS-level stealth injection and HITL (Human-In-The-Loop) fallback for solving CAPTCHAs. - Internal Meta-Search: Parallel search across Google, Bing, DuckDuckGo, and Brave without external API keys. - Smart Ad-Blocking: Built-in high-speed aho-corasick engine to strip ads and trackers before extraction. - Semantic Memory: Embedded LanceDB for 100% local, private research history recall. - AI-Optimized Markdown: Delivers ultra-clean content stripped of "Buddhist Era" dates and web noise. Tools list: search_web β€” federated search (No API Key needed) search_structured β€” search + top result scraping scrape_url β€” single URL extraction scrape_batch β€” multi-URL parallel scraping crawl_website β€” bounded recursive crawling extract_structured β€” schema-driven extraction research_history β€” semantic recall from prior runs proxy_manager β€” proxy list/status/switch/test/grab operations non_robot_search β€” [NEW] The "Nuclear Option" for Boss-level anti-bots (LinkedIn/Cloudflare) with HITL. **Pure Rust MCP Server** ShadowCrawl is a high-performance, Zero-Docker MCP server written in Rust. It serves as a 100% private, sovereign alternative to Firecrawl, Jina Reader, and Tavily. Unlike other scrapers, ShadowCrawl v2.3.0 runs as a single standalone binary with native Chromium control (CDP) and a Human-In-The-Loop (HITL) fallback system, ensuring you can bypass 99.9% of bot protections (Cloudflare, DataDome

MCPself-declared

Public facts

4

Change events

1

Artifacts

0

Freshness

Apr 15, 2026

Verifiededitorial-contentNo verified compatibility signals

Capability contract not published. No trust telemetry is available yet. Last updated 4/15/2026.

Trust evidence available

Trust score

Unknown

Compatibility

MCP

Freshness

Apr 15, 2026

Vendor

Devshero

Artifacts

0

Benchmarks

0

Last release

Unpublished

Executive Summary

Key links, install path, and a quick operational read before the deeper crawl record.

Verifiededitorial-content

Summary

Capability contract not published. No trust telemetry is available yet. Last updated 4/15/2026.

Setup snapshot

  1. 1

    Setup complexity is LOW. This package is likely designed for quick installation with minimal external side-effects.

  2. 2

    Final validation: Expose the agent to a mock request payload inside a sandbox and trace the network egress before allowing access to real customer data.

Evidence Ledger

Everything public we have scraped or crawled about this agent, grouped by evidence type with provenance.

Verifiededitorial-content
Vendor (1)

Vendor

Devshero

profilemedium
Observed Apr 15, 2026Source linkProvenance
Compatibility (1)

Protocol compatibility

MCP

contractmedium
Observed Apr 15, 2026Source linkProvenance
Security (1)

Handshake status

UNKNOWN

trustmedium
Observed unknownSource linkProvenance
Integration (1)

Crawlable docs

6 indexed pages on the official domain

search_documentmedium
Observed Apr 15, 2026Source linkProvenance

Release & Crawl Timeline

Merged public release, docs, artifact, benchmark, pricing, and trust refresh events.

Self-declaredagent-index

Artifacts Archive

Extracted files, examples, snippets, parameters, dependencies, permissions, and artifact metadata.

Self-declaredSmithery

Extracted files

0

Examples

0

Snippets

0

Languages

Unknown

Docs & README

Full documentation captured from public sources, including the complete README when available.

Self-declaredSmithery

Docs source

Smithery

Editorial quality

ready

**Pure Rust MCP Server** ShadowCrawl is a high-performance, Zero-Docker MCP server written in Rust. It serves as a 100% private, sovereign alternative to Firecrawl, Jina Reader, and Tavily. Unlike other scrapers, ShadowCrawl v2.3.0 runs as a single standalone binary with native Chromium control (CDP) and a Human-In-The-Loop (HITL) fallback system, ensuring you can bypass 99.9% of bot protections (Cloudflare, DataDome) without complex infrastructure. Why AI Agents love ShadowCrawl: - Zero-Docker & Zero-Config: No Redis, No Qdrant, No SearXNG. Single binary setup. - God-Tier Anti-Bot Bypass: Native Chromiumoxide (CDP) with JS-level stealth injection and HITL (Human-In-The-Loop) fallback for solving CAPTCHAs. - Internal Meta-Search: Parallel search across Google, Bing, DuckDuckGo, and Brave without external API keys. - Smart Ad-Blocking: Built-in high-speed aho-corasick engine to strip ads and trackers before extraction. - Semantic Memory: Embedded LanceDB for 100% local, private research history recall. - AI-Optimized Markdown: Delivers ultra-clean content stripped of "Buddhist Era" dates and web noise. Tools list: search_web β€” federated search (No API Key needed) search_structured β€” search + top result scraping scrape_url β€” single URL extraction scrape_batch β€” multi-URL parallel scraping crawl_website β€” bounded recursive crawling extract_structured β€” schema-driven extraction research_history β€” semantic recall from prior runs proxy_manager β€” proxy list/status/switch/test/grab operations non_robot_search β€” [NEW] The "Nuclear Option" for Boss-level anti-bots (LinkedIn/Cloudflare) with HITL. **Pure Rust MCP Server** ShadowCrawl is a high-performance, Zero-Docker MCP server written in Rust. It serves as a 100% private, sovereign alternative to Firecrawl, Jina Reader, and Tavily. Unlike other scrapers, ShadowCrawl v2.3.0 runs as a single standalone binary with native Chromium control (CDP) and a Human-In-The-Loop (HITL) fallback system, ensuring you can bypass 99.9% of bot protections (Cloudflare, DataDome

Full README

Pure Rust MCP Server

ShadowCrawl is a high-performance, Zero-Docker MCP server written in Rust. It serves as a 100% private, sovereign alternative to Firecrawl, Jina Reader, and Tavily.

Unlike other scrapers, ShadowCrawl v2.3.0 runs as a single standalone binary with native Chromium control (CDP) and a Human-In-The-Loop (HITL) fallback system, ensuring you can bypass 99.9% of bot protections (Cloudflare, DataDome) without complex infrastructure.

Why AI Agents love ShadowCrawl:

  • Zero-Docker & Zero-Config: No Redis, No Qdrant, No SearXNG. Single binary setup.
  • God-Tier Anti-Bot Bypass: Native Chromiumoxide (CDP) with JS-level stealth injection and HITL (Human-In-The-Loop) fallback for solving CAPTCHAs.
  • Internal Meta-Search: Parallel search across Google, Bing, DuckDuckGo, and Brave without external API keys.
  • Smart Ad-Blocking: Built-in high-speed aho-corasick engine to strip ads and trackers before extraction.
  • Semantic Memory: Embedded LanceDB for 100% local, private research history recall.
  • AI-Optimized Markdown: Delivers ultra-clean content stripped of "Buddhist Era" dates and web noise.

Tools list:

search_web β€” federated search (No API Key needed) search_structured β€” search + top result scraping scrape_url β€” single URL extraction scrape_batch β€” multi-URL parallel scraping crawl_website β€” bounded recursive crawling extract_structured β€” schema-driven extraction research_history β€” semantic recall from prior runs proxy_manager β€” proxy list/status/switch/test/grab operations non_robot_search β€” [NEW] The "Nuclear Option" for Boss-level anti-bots (LinkedIn/Cloudflare) with HITL.

Contract & API

Machine endpoints, protocol fit, contract coverage, invocation examples, and guardrails for agent-to-agent use.

MissingSmithery

Contract coverage

Status

missing

Auth

None

Streaming

No

Data region

Unspecified

Protocol support

MCP: self-declared

Requires: none

Forbidden: none

Guardrails

Operational confidence: low

No positive guardrails captured.
Invocation examples
curl -s "https://www.xpersona.co/api/v1/agents/smithery-devshero-shadowcrawl/snapshot"
curl -s "https://www.xpersona.co/api/v1/agents/smithery-devshero-shadowcrawl/contract"
curl -s "https://www.xpersona.co/api/v1/agents/smithery-devshero-shadowcrawl/trust"

Reliability & Benchmarks

Trust and runtime signals, benchmark suites, failure patterns, and practical risk constraints.

Missingruntime-metrics

Trust signals

Handshake

UNKNOWN

Confidence

unknown

Attempts 30d

unknown

Fallback rate

unknown

Runtime metrics

Observed P50

unknown

Observed P95

unknown

Rate limit

unknown

Estimated cost

unknown

Do not use if

Contract metadata is missing or unavailable for deterministic execution.
No benchmark suites or observed failure patterns are available.

Media & Demo

Every public screenshot, visual asset, demo link, and owner-provided destination tied to this agent.

Missingno-media
No screenshots, media assets, or demo links are available.

Related Agents

Neighboring agents from the same protocol and source ecosystem for comparison and shortlist building.

Self-declaredprotocol-neighbors
Ard RegistryUpdated 0h agoRank 94

Market Recap

Market Recap MCP β€” a one-call 'what happened in markets' snapshot.

MCPmcpmcp-registry
Ard RegistryUpdated 0h agoRank 94

FinBridge

Korean stock research MCP: DART financials, global filings, daily prices and research tools.

MCPmcpmcp-registry
Ard RegistryUpdated 0h agoRank 94

ai.jawz/jawz

Live macro data for AI agents: regime, conditions, liquidity, with input provenance.

MCPmcpmcp-registry
Machine Appendix

Contract JSON

{
  "contractStatus": "missing",
  "authModes": [],
  "requires": [],
  "forbidden": [],
  "supportsMcp": false,
  "supportsA2a": false,
  "supportsStreaming": false,
  "inputSchemaRef": null,
  "outputSchemaRef": null,
  "dataRegion": null,
  "contractUpdatedAt": null,
  "sourceUpdatedAt": null,
  "freshnessSeconds": null
}

Invocation Guide

{
  "preferredApi": {
    "snapshotUrl": "https://www.xpersona.co/api/v1/agents/smithery-devshero-shadowcrawl/snapshot",
    "contractUrl": "https://www.xpersona.co/api/v1/agents/smithery-devshero-shadowcrawl/contract",
    "trustUrl": "https://www.xpersona.co/api/v1/agents/smithery-devshero-shadowcrawl/trust"
  },
  "curlExamples": [
    "curl -s \"https://www.xpersona.co/api/v1/agents/smithery-devshero-shadowcrawl/snapshot\"",
    "curl -s \"https://www.xpersona.co/api/v1/agents/smithery-devshero-shadowcrawl/contract\"",
    "curl -s \"https://www.xpersona.co/api/v1/agents/smithery-devshero-shadowcrawl/trust\""
  ],
  "jsonRequestTemplate": {
    "query": "summarize this repo",
    "constraints": {
      "maxLatencyMs": 2000,
      "protocolPreference": [
        "MCP"
      ]
    }
  },
  "jsonResponseTemplate": {
    "ok": true,
    "result": {
      "summary": "...",
      "confidence": 0.9
    },
    "meta": {
      "source": "SMITHERY",
      "generatedAt": "2026-10-09T03:05:46.019Z"
    }
  },
  "retryPolicy": {
    "maxAttempts": 3,
    "backoffMs": [
      500,
      1500,
      3500
    ],
    "retryableConditions": [
      "HTTP_429",
      "HTTP_503",
      "NETWORK_TIMEOUT"
    ]
  }
}

Trust JSON

{
  "status": "unavailable",
  "handshakeStatus": "UNKNOWN",
  "verificationFreshnessHours": null,
  "reputationScore": null,
  "p95LatencyMs": null,
  "successRate30d": null,
  "fallbackRate": null,
  "attempts30d": null,
  "trustUpdatedAt": null,
  "trustConfidence": "unknown",
  "sourceUpdatedAt": null,
  "freshnessSeconds": null
}

Capability Matrix

{
  "rows": [
    {
      "key": "MCP",
      "type": "protocol",
      "support": "unknown",
      "confidenceSource": "profile",
      "notes": "Listed on profile"
    }
  ],
  "flattenedTokens": "protocol:MCP|unknown|profile"
}

Facts JSON

[
  {
    "factKey": "docs_crawl",
    "label": "Crawlable docs",
    "value": "6 indexed pages on the official domain",
    "category": "integration",
    "href": "https://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fopenclaw%2Fskills%2Ftree%2Fmain%2Fskills%2Fasleep123%2Fcaldav-calendar",
    "sourceUrl": "https://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fopenclaw%2Fskills%2Ftree%2Fmain%2Fskills%2Fasleep123%2Fcaldav-calendar",
    "sourceType": "search_document",
    "confidence": "medium",
    "observedAt": "2026-04-15T05:03:46.393Z",
    "isPublic": true,
    "metadata": {}
  },
  {
    "factKey": "vendor",
    "label": "Vendor",
    "value": "Devshero",
    "category": "vendor",
    "href": "https://github.com/DevsHero/ShadowCrawl",
    "sourceUrl": "https://github.com/DevsHero/ShadowCrawl",
    "sourceType": "profile",
    "confidence": "medium",
    "observedAt": "2026-04-15T00:48:45.152Z",
    "isPublic": true,
    "metadata": {}
  },
  {
    "factKey": "protocols",
    "label": "Protocol compatibility",
    "value": "MCP",
    "category": "compatibility",
    "href": "https://www.xpersona.co/api/v1/agents/smithery-devshero-shadowcrawl/contract",
    "sourceUrl": "https://www.xpersona.co/api/v1/agents/smithery-devshero-shadowcrawl/contract",
    "sourceType": "contract",
    "confidence": "medium",
    "observedAt": "2026-04-15T00:48:45.152Z",
    "isPublic": true,
    "metadata": {}
  },
  {
    "factKey": "handshake_status",
    "label": "Handshake status",
    "value": "UNKNOWN",
    "category": "security",
    "href": "https://www.xpersona.co/api/v1/agents/smithery-devshero-shadowcrawl/trust",
    "sourceUrl": "https://www.xpersona.co/api/v1/agents/smithery-devshero-shadowcrawl/trust",
    "sourceType": "trust",
    "confidence": "medium",
    "observedAt": null,
    "isPublic": true,
    "metadata": {}
  }
]

Change Events JSON

[
  {
    "eventType": "docs_update",
    "title": "Docs refreshed: Sign in to GitHub Β· GitHub",
    "description": "Fresh crawlable documentation was indexed for the official domain.",
    "href": "https://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fopenclaw%2Fskills%2Ftree%2Fmain%2Fskills%2Fasleep123%2Fcaldav-calendar",
    "sourceUrl": "https://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fopenclaw%2Fskills%2Ftree%2Fmain%2Fskills%2Fasleep123%2Fcaldav-calendar",
    "sourceType": "search_document",
    "confidence": "medium",
    "observedAt": "2026-04-15T05:03:46.393Z",
    "isPublic": true,
    "metadata": {}
  }
]

Sponsored

Ads related to πŸ₯· ShadowCrawl: The Zero-Docker "Unstoppable" Stealth Scraper & Search and adjacent AI workflows.