agentCLAWHUBUnverified

RAG Pipeline Starter

Set up and optimize RAG pipelines for large datasets (50K-500K rows) with document chunking, embedding benchmarking, vector indexing, and retrieval tuning. Skill: RAG Pipeline Starter Owner: abhinas90 Summary: Set up and optimize RAG pipelines for large datasets (50K-500K rows) with document chunking, embedding benchmarking, vector indexing, and retrieval tuning. Tags: latest:1.0.1 Version history: v1.0.1 | 2026-05-31T18:10:30.016Z | user Release 1.0.1: RAG Pipeline Starter v1.0.0 | 2026-04-18T14:02:27.797Z | user Initial release Archive index: Archive v1.0.1: 8 files,

OpenClaw

Rank

62

Safety

84

Downloads

981

Updated

Oct 11, 2026

Version

1.0.1

Source

CLAWHUB

About

What it does, and when to use it.

Capability contract not published. No trust telemetry is available yet. 981 downloads reported by the source. Last updated 10/11/2026.

Avoid when

  • Contract metadata is missing or unavailable for deterministic execution.

Risk flags: missing_or_unavailable_contract, trust_data_unavailable, schema_references_missing

Public facts

Every fact links back to the source it came from.

Vendor
Clawhubvendor · observed Oct 11, 2026
Protocol compatibility
OpenClawcompatibility · observed Oct 11, 2026
Adoption signal
981 downloadsadoption · observed Oct 11, 2026
Latest release
1.0.1release · observed May 31, 2026
Handshake status
UNKNOWNsecurity

What changed

Newest first. Only changes that point at a source are listed.

Install and run

Setup complexity: low.

clawhub skill install s174azs5nksq9sp64tzargsaph84203h:rag-pipeline-starter
  1. Setup complexity is LOW. This package is likely designed for quick installation with minimal external side-effects.
  2. Final validation: Expose the agent to a mock request payload inside a sandbox and trace the network egress before allowing access to real customer data.

Contract: missing

curl -s "https://www.xpersona.co/api/v1/agents/clawhub-abhinas90-rag-pipeline-starter/snapshot"

Run-check

$0.02 USD

1 measured facts are behind this paywall: success rate and latency, uptime and estimated cost, when not to use it, how to call it, benchmark scores.

Agents pay $0.02 in USDC. A card payment is $0.50, the smallest a card allows.

Documentation

CLAWHUB

17,213 characters of source documentation, loaded on request.

Extracted files

4 files captured from the source.

SKILL.md

# RAG Pipeline Starter

Production-grade RAG pipeline setup with chunking strategies, embedding benchmarks, and retrieval tuning for 50K-500K row datasets.

## Overview

This skill provides a complete toolkit for building and optimizing RAG (Retrieval-Augmented Generation) pipelines. It analyzes your data, recommends optimal chunking strategies, benchmarks embedding models, and helps tune retrieval parameters for maximum accuracy.

## When to Use

- Building a new RAG system from scratch
- Optimizing an existing RAG pipeline's retrieval quality
- Choosing the right embedding model for your domain
- Processing large document collections (50K-500K rows)
- Need to balance speed vs. accuracy for your use case

## Scripts

### chunking_analyzer.py
Analyzes documents and recommends optimal chunking strategies based on content structure.

**Usage:**
```bash
# Assess data and get strategy recommendation
python chunking_analyzer.py --assess ./data

# Apply chunking strategy to documents
python chunking_analyzer.py --strategy recursive --input ./data/doc.txt --output ./chunks/ --chunk-size 500 --overlap 50
```

**Options:**
- `--assess <dir>` - Analyze documents and recommend strategy
- `--strategy <name>` - Chunking strategy: fixed, semantic, recursive, hierarchical
- `--input <path>` - Input file or directory
- `--output <dir>` - Output directory for chunks
- `--chunk-size <int>` - Chunk size (default: 500)
- `--overlap <int>` - Overlap between chunks (default: 50)

### embedding_benchmark.py
Tests multiple embedding models on your data to find the best fit for your domain.

**Usage:**
```bash
python embedding_benchmark.py --data ./chunks/ --domain finance --output results.json
```

**Options:**
- `--embeddings <models>` - Embedding models to test (space-separated)
- `--data <dir>` - Directory with chunked text files (required)
- `--domain <name>` - Domain name for context-specific recommendations
- `--output <file>` - Output file for results (JSON)

**Supported Embeddings:**
- sentence-transformers/all-MiniLM-L6-v2 (384 dims, fast, free)
- sentence-transformers/all-mpnet-base-v2 (768 dims, medium, free)
- openai/text-embedding-ada-002 (1536 dims, fast, paid)
- cohere/embed-english-v3.0 (1024 dims, fast, paid)
- bm25 (sparse, fast, free)

### retrieval_tuner.py
Optimizes retrieval parameters (top-k, similarity threshold) for your specific use case.

**Usage:**
```bash
python retrieval_tuner.py --index ./vector_store/ --queries ./test_queries.json --output tuning_results.json
```

**Options:**
- `--index <dir>` - Vector store index directory
- `--queries <file>` - JSON file with test queries and expected results
- `--output <file>` - Output file for tuning results
- `--top-k-range <min> <max>` - Range of top-k values to test (default: 1 20)
- `--threshold-range <min> <max> <step>` - Similarity threshold range

### vector_store_manager.py
Manages vector store operations: create, update, search, and maintain indexes.

**Usage:**
```bash
# Create index from 

_meta.json

{
  "ownerId": "kn71hf14zhnh60jg0jb31zthnh8421nq",
  "slug": "rag-pipeline-starter",
  "version": "1.0.1",
  "publishedAt": 1780251030016
}

skill-card.md

## Description:

Set up and optimize RAG pipelines for large datasets with document chunking, embedding benchmarking, vector indexing, and retrieval tuning.

This skill is ready for commercial/non-commercial use.

## Publisher:

[abhinas90](https://clawhub.ai/user/abhinas90)

### License/Terms of Use:

MIT-0

## Use Case:

Developers and engineers use this skill to create or improve local RAG pipelines for large document collections, including chunking, embedding selection, vector index management, and retrieval parameter tuning.

### Deployment Geography for Use:

Global

## Known Risks and Mitigations:

Risk: The skill reads chosen document folders and writes derived chunks, results, and index files.

Mitigation: Run it in dedicated working directories and avoid pointing outputs at important folders.

Risk: Using hosted embedding APIs in future extensions could send document chunks or queries to external providers.

Mitigation: Treat hosted embedding use as a separate privacy decision and prefer local models for sensitive data.

Risk: Retrieval and benchmark recommendations may be affected by simplified scoring paths and data-handling caveats.

Mitigation: Validate recommendations with representative queries and reviewed evaluation data before relying on them in production.

## Reference(s):

- [RAG Pipeline Starter ClawHub page](https://clawhub.ai/abhinas90/skills/rag-pipeline-starter)
- [Publisher profile](https://clawhub.ai/user/abhinas90)
- [Skill documentation](artifact/SKILL.md)

## Skill Output:

**Output Type(s):** [text, markdown, code, shell commands, configuration, guidance]

**Output Format:** [Markdown guidance with Python command examples, console text, JSON results, and generated local files]

**Output Parameters:** [1D]

**Other Properties Related to Output:** [May read user-selected document folders and write derived chunks, benchmark results, tuning results, and vector index files.]

## Skill Version(s):

1.0.1 (source: server release evidence and skill.json)

## Ethical Considerations:

Users should evaluate whether this skill is appropriate for their environment, review any generated or modified files before relying on them, and apply their organization's safety, security, and compliance requirements before deployment.

skill.json

{
  "slug": "rag-pipeline-starter",
  "name": "RAG Pipeline Starter",
  "version": "1.0.1",
  "description": "Production-grade RAG pipeline setup with chunking strategies, embedding benchmarks, and retrieval tuning for 50K-500K row datasets",
  "author": "Abhinas Neupane",
  "tags": [
    "RAG",
    "retrieval",
    "embeddings",
    "LLM",
    "vector-database",
    "chunking",
    "benchmark"
  ],
  "pricing": {
    "type": "one-time",
    "value": 0
  },
  "scripts": [
    "chunking_analyzer.py",
    "embedding_benchmark.py",
    "retrieval_tuner.py",
    "vector_store_manager.py"
  ],
  "requirements": {
    "python": ">=3.8",
    "dependencies": []
  }
}
Github ReposUpdated 3d agoRank 70

AionUi

Free, local, open-source 24/7 Cowork app and OpenClaw for Gemini CLI, Claude Code, Codex, OpenCode, Qwen Code, Goose CLI, Auggie, and more | 🌟 Star if you like it!

MCPOPENCLAW
Github ReposUpdated 6mo agoRank 70

activepieces

AI Agents & MCPs & AI Workflow Automation • (~400 MCP servers for AI agents) • AI Automation / AI Agent with MCPs • AI Workflows & AI Agents • MCPs for AI Agents

OPENCLAW
Github ReposUpdated 6mo agoRank 70

cherry-studio

AI productivity studio with smart chat, autonomous agents, and 300+ assistants.

MCPOPENCLAW
Github ReposUpdated 7mo agoRank 70

CopilotKit

The Frontend for Agents & Generative UI. React + Angular

OPENCLAW

Machine-readable data

The same record, as JSON, for agents and crawlers.

{
  "facts": [
    {
      "factKey": "vendor",
      "category": "vendor",
      "label": "Vendor",
      "value": "Clawhub",
      "href": "https://clawhub.ai/abhinas90/skills/rag-pipeline-starter",
      "sourceUrl": "https://clawhub.ai/abhinas90/skills/rag-pipeline-starter",
      "sourceType": "profile",
      "confidence": "medium",
      "observedAt": "2026-10-11T22:53:32.607Z",
      "isPublic": true
    },
    {
      "factKey": "protocols",
      "category": "compatibility",
      "label": "Protocol compatibility",
      "value": "OpenClaw",
      "href": "https://www.xpersona.co/api/v1/agents/clawhub-abhinas90-rag-pipeline-starter/contract",
      "sourceUrl": "https://www.xpersona.co/api/v1/agents/clawhub-abhinas90-rag-pipeline-starter/contract",
      "sourceType": "contract",
      "confidence": "medium",
      "observedAt": "2026-10-11T22:53:32.607Z",
      "isPublic": true
    },
    {
      "factKey": "traction",
      "category": "adoption",
      "label": "Adoption signal",
      "value": "981 downloads",
      "href": "https://clawhub.ai/abhinas90/rag-pipeline-starter",
      "sourceUrl": "https://clawhub.ai/abhinas90/rag-pipeline-starter",
      "sourceType": "profile",
      "confidence": "medium",
      "observedAt": "2026-10-11T22:53:32.607Z",
      "isPublic": true
    },
    {
      "factKey": "latest_release",
      "category": "release",
      "label": "Latest release",
      "value": "1.0.1",
      "href": "https://clawhub.ai/abhinas90/rag-pipeline-starter",
      "sourceUrl": "https://clawhub.ai/abhinas90/rag-pipeline-starter",
      "sourceType": "release",
      "confidence": "medium",
      "observedAt": "2026-05-31T18:10:30.016Z",
      "isPublic": true
    },
    {
      "factKey": "handshake_status",
      "category": "security",
      "label": "Handshake status",
      "value": "UNKNOWN",
      "href": "https://www.xpersona.co/api/v1/agents/clawhub-abhinas90-rag-pipeline-starter/trust",
      "sourceUrl": "https://www.xpersona.co/api/v1/agents/clawhub-abhinas90-rag-pipeline-starter/trust",
      "sourceType": "trust",
      "confidence": "medium",
      "observedAt": null,
      "isPublic": true
    }
  ],
  "events": [
    {
      "eventType": "release",
      "title": "Release 1.0.1",
      "description": "Release 1.0.1: RAG Pipeline Starter",
      "href": "https://clawhub.ai/abhinas90/rag-pipeline-starter",
      "sourceUrl": "https://clawhub.ai/abhinas90/rag-pipeline-starter",
      "sourceType": "release",
      "confidence": "medium",
      "observedAt": "2026-05-31T18:10:30.016Z",
      "isPublic": true
    }
  ]
}

Record generated Oct 12, 2026.

For crawlers

This page is free to read. The run-check above is the only paid part, and it answers HTTP 402 until it is paid. Everything else here is public.

  • One record, as JSON: card, facts, snapshot, contract, trust, changes, warnings, seen by, disagreements.
  • Every agent, one feed: /.well-known/ai-catalog.json
  • What this site sells, and the price: /.well-known/x402
  • Paid run-check: /api/v1/agents/clawhub-abhinas90-rag-pipeline-starter/run-check

Sponsored

Ads related to RAG Pipeline Starter and adjacent AI workflows.