Crawler Summary

redpanda-migrator-tuning answer-first brief

Tune Redpanda Migrator for optimal Kafka throughput. Use when optimizing data migration performance, configuring migrator batch sizes and buffers, scaling multi-partition migrations, or troubleshooting slow migration speeds. Covers max_yield_batch_bytes, partition_buffer_bytes, compression, and max_in_flight configuration. --- name: redpanda-migrator-tuning description: Tune Redpanda Migrator for optimal Kafka throughput. Use when optimizing data migration performance, configuring migrator batch sizes and buffers, scaling multi-partition migrations, or troubleshooting slow migration speeds. Covers max_yield_batch_bytes, partition_buffer_bytes, compression, and max_in_flight configuration. --- Redpanda Migrator Performance Tuning Expert Capability contract not published. No trust telemetry is available yet. Last updated 4/15/2026.

Freshness

Last checked 4/15/2026

Best For

redpanda-migrator-tuning is best for general automation workflows where OpenClaw compatibility matters.

Not Ideal For

Contract metadata is missing or unavailable for deterministic execution.

Evidence Sources Checked

editorial-content, GITHUB OPENCLEW, runtime-metrics, public facts pack

Claim this agent
Agent DossierGitHubSafety: 80/100

redpanda-migrator-tuning

Tune Redpanda Migrator for optimal Kafka throughput. Use when optimizing data migration performance, configuring migrator batch sizes and buffers, scaling multi-partition migrations, or troubleshooting slow migration speeds. Covers max_yield_batch_bytes, partition_buffer_bytes, compression, and max_in_flight configuration. --- name: redpanda-migrator-tuning description: Tune Redpanda Migrator for optimal Kafka throughput. Use when optimizing data migration performance, configuring migrator batch sizes and buffers, scaling multi-partition migrations, or troubleshooting slow migration speeds. Covers max_yield_batch_bytes, partition_buffer_bytes, compression, and max_in_flight configuration. --- Redpanda Migrator Performance Tuning Expert

OpenClawself-declared

Public facts

4

Change events

1

Artifacts

0

Freshness

Apr 15, 2026

Verifiededitorial-contentNo verified compatibility signals

Capability contract not published. No trust telemetry is available yet. Last updated 4/15/2026.

Trust evidence available

Trust score

Unknown

Compatibility

OpenClaw

Freshness

Apr 15, 2026

Vendor

Ajurcenk

Artifacts

0

Benchmarks

0

Last release

Unpublished

Executive Summary

Key links, install path, and a quick operational read before the deeper crawl record.

Verifiededitorial-content

Summary

Capability contract not published. No trust telemetry is available yet. Last updated 4/15/2026.

Setup snapshot

git clone https://github.com/ajurcenk/claude_code_redpanda_migrator_cfg_tuning_agent_skills.git
  1. 1

    Setup complexity is LOW. This package is likely designed for quick installation with minimal external side-effects.

  2. 2

    Final validation: Expose the agent to a mock request payload inside a sandbox and trace the network egress before allowing access to real customer data.

Evidence Ledger

Everything public we have scraped or crawled about this agent, grouped by evidence type with provenance.

Verifiededitorial-content
Vendor (1)

Vendor

Ajurcenk

profilemedium
Observed Apr 15, 2026Source linkProvenance
Compatibility (1)

Protocol compatibility

OpenClaw

contractmedium
Observed Apr 15, 2026Source linkProvenance
Security (1)

Handshake status

UNKNOWN

trustmedium
Observed unknownSource linkProvenance
Integration (1)

Crawlable docs

6 indexed pages on the official domain

search_documentmedium
Observed Apr 15, 2026Source linkProvenance

Release & Crawl Timeline

Merged public release, docs, artifact, benchmark, pricing, and trust refresh events.

Self-declaredagent-index

Artifacts Archive

Extracted files, examples, snippets, parameters, dependencies, permissions, and artifact metadata.

Self-declaredGITHUB OPENCLEW

Extracted files

0

Examples

1

Snippets

0

Languages

typescript

Parameters

Executable Examples

bash

# Start migrator with defaults and measure throughput
# Record: records/second, duration, memory usage

Docs & README

Full documentation captured from public sources, including the complete README when available.

Self-declaredGITHUB OPENCLEW

Docs source

GITHUB OPENCLEW

Editorial quality

ready

Tune Redpanda Migrator for optimal Kafka throughput. Use when optimizing data migration performance, configuring migrator batch sizes and buffers, scaling multi-partition migrations, or troubleshooting slow migration speeds. Covers max_yield_batch_bytes, partition_buffer_bytes, compression, and max_in_flight configuration. --- name: redpanda-migrator-tuning description: Tune Redpanda Migrator for optimal Kafka throughput. Use when optimizing data migration performance, configuring migrator batch sizes and buffers, scaling multi-partition migrations, or troubleshooting slow migration speeds. Covers max_yield_batch_bytes, partition_buffer_bytes, compression, and max_in_flight configuration. --- Redpanda Migrator Performance Tuning Expert

Full README

name: redpanda-migrator-tuning description: Tune Redpanda Migrator for optimal Kafka throughput. Use when optimizing data migration performance, configuring migrator batch sizes and buffers, scaling multi-partition migrations, or troubleshooting slow migration speeds. Covers max_yield_batch_bytes, partition_buffer_bytes, compression, and max_in_flight configuration.

Redpanda Migrator Performance Tuning

Expert guidance for tuning Redpanda Migrator configuration to maximize Kafka throughput during data migration.

Quick Start

When asked to tune Redpanda Migrator performance:

  1. Establish baseline - Test single partition with defaults
  2. Tune parameters - Adjust batch/buffer sizes for your network
  3. Scale horizontally - Add instances up to partition count
  4. Validate - Run sustained tests (30-60 minutes)

Critical Parameters

Input Component

max_yield_batch_bytes (Default: 32KB)

  • Maximum batch size yielded to pipeline
  • Batches are split if exceeding this size
  • Does NOT control consumer pause decisions

partition_buffer_bytes (Default: 1MB)

  • Per-partition memory buffer limit
  • Controls when consumer pauses/resumes (resumes at 90%)
  • Soft limit - large messages never rejected
  • Memory: Total ≈ partition_count × partition_buffer_bytes

Critical Rule: partition_buffer_bytes >= max_yield_batch_bytes (ideally 10x)

Output Component

compression (Default: snappy)

  • Options: lz4, snappy, gzip, zstd, none
  • lz4: fast, good compression
  • zstd: best compression, more CPU

max_in_flight (Default: 10, Requires: Redpanda Connect ≥4.71.0)

  • Number of parallel worker goroutines
  • Optimal: Set to total partition count
  • Setting higher than partition count provides no benefit

Tuning Workflow

Step 1: Establish Baseline

Test single partition with default configuration:

# Start migrator with defaults and measure throughput
# Record: records/second, duration, memory usage

See templates/baseline-config.yaml for baseline configuration.

Step 2: Tune Single Partition

Same Region (Low Latency):

  • Increase to: max_yield_batch_bytes=10MB, partition_buffer_bytes=100MB
  • Use compression: lz4 or snappy

Cross-Region/Intercontinental (High Latency):

  • Same batch settings as above
  • Add fetch tuning: fetch_min_bytes=1MB, fetch_max_bytes=64MB
  • Use compression: lz4 or zstd

See templates/ for configuration templates:

  • same-region-tuned.yaml - Same region optimized config
  • cross-region-tuned.yaml - Cross-region with fetch tuning

Step 3: Scale Horizontally

Add instances up to partition count. All must use same consumer_group.

Update max_in_flight = total_partition_count in output configuration.

See templates/multi-partition-config.yaml for multi-partition setup.

Step 4: Validate

Run sustained test (30-60+ minutes) monitoring:

  • Consumer lag per partition
  • No repeated rebalances
  • CPU/memory within limits
  • Consistent throughput

Key Rules

  1. partition_buffer_bytes >= 10x max_yield_batch_bytes
  2. Total Memory ≈ partition_count × partition_buffer_bytes
  3. max_in_flight = total_partition_count
  4. All instances must use identical consumer_group
  5. Maximum instances = total partition count

Common Issues

Low Throughput:

  • Check: Is max_yield > partition_buffer? (Fix: increase buffer)
  • Check: Are fetch parameters tuned for network latency?
  • Check: Is max_in_flight set to partition count?

High Memory:

  • Calculate: partition_count × partition_buffer_bytes
  • Reduce partition_buffer_bytes or split across more instances

Frequent Rebalancing:

  • Verify all instances use same consumer_group
  • Check network stability and instance resources

Additional Resources

References

Contract & API

Machine endpoints, protocol fit, contract coverage, invocation examples, and guardrails for agent-to-agent use.

MissingGITHUB OPENCLEW

Contract coverage

Status

missing

Auth

None

Streaming

No

Data region

Unspecified

Protocol support

OpenClaw: self-declared

Requires: none

Forbidden: none

Guardrails

Operational confidence: low

No positive guardrails captured.
Invocation examples
curl -s "https://www.xpersona.co/api/v1/agents/ajurcenk-claude-code-redpanda-migrator-cfg-tuning-agent-skills/snapshot"
curl -s "https://www.xpersona.co/api/v1/agents/ajurcenk-claude-code-redpanda-migrator-cfg-tuning-agent-skills/contract"
curl -s "https://www.xpersona.co/api/v1/agents/ajurcenk-claude-code-redpanda-migrator-cfg-tuning-agent-skills/trust"

Reliability & Benchmarks

Trust and runtime signals, benchmark suites, failure patterns, and practical risk constraints.

Missingruntime-metrics

Trust signals

Handshake

UNKNOWN

Confidence

unknown

Attempts 30d

unknown

Fallback rate

unknown

Runtime metrics

Observed P50

unknown

Observed P95

unknown

Rate limit

unknown

Estimated cost

unknown

Do not use if

Contract metadata is missing or unavailable for deterministic execution.
No benchmark suites or observed failure patterns are available.

Media & Demo

Every public screenshot, visual asset, demo link, and owner-provided destination tied to this agent.

Missingno-media
No screenshots, media assets, or demo links are available.

Related Agents

Neighboring agents from the same protocol and source ecosystem for comparison and shortlist building.

Self-declaredprotocol-neighbors
Github ReposUpdated 1h agoRank 70

AionUi

Free, local, open-source 24/7 Cowork app and OpenClaw for Gemini CLI, Claude Code, Codex, OpenCode, Qwen Code, Goose CLI, Auggie, and more | 🌟 Star if you like it!

MCPOPENCLAW
Github ReposUpdated 6mo agoRank 70

activepieces

AI Agents & MCPs & AI Workflow Automation • (~400 MCP servers for AI agents) • AI Automation / AI Agent with MCPs • AI Workflows & AI Agents • MCPs for AI Agents

OPENCLAW
Github ReposUpdated 6mo agoRank 70

cherry-studio

AI productivity studio with smart chat, autonomous agents, and 300+ assistants.

MCPOPENCLAW
Github ReposUpdated 7mo agoRank 70

CopilotKit

The Frontend for Agents & Generative UI. React + Angular

OPENCLAW
Machine Appendix

Contract JSON

{
  "contractStatus": "missing",
  "authModes": [],
  "requires": [],
  "forbidden": [],
  "supportsMcp": false,
  "supportsA2a": false,
  "supportsStreaming": false,
  "inputSchemaRef": null,
  "outputSchemaRef": null,
  "dataRegion": null,
  "contractUpdatedAt": null,
  "sourceUpdatedAt": null,
  "freshnessSeconds": null
}

Invocation Guide

{
  "preferredApi": {
    "snapshotUrl": "https://www.xpersona.co/api/v1/agents/ajurcenk-claude-code-redpanda-migrator-cfg-tuning-agent-skills/snapshot",
    "contractUrl": "https://www.xpersona.co/api/v1/agents/ajurcenk-claude-code-redpanda-migrator-cfg-tuning-agent-skills/contract",
    "trustUrl": "https://www.xpersona.co/api/v1/agents/ajurcenk-claude-code-redpanda-migrator-cfg-tuning-agent-skills/trust"
  },
  "curlExamples": [
    "curl -s \"https://www.xpersona.co/api/v1/agents/ajurcenk-claude-code-redpanda-migrator-cfg-tuning-agent-skills/snapshot\"",
    "curl -s \"https://www.xpersona.co/api/v1/agents/ajurcenk-claude-code-redpanda-migrator-cfg-tuning-agent-skills/contract\"",
    "curl -s \"https://www.xpersona.co/api/v1/agents/ajurcenk-claude-code-redpanda-migrator-cfg-tuning-agent-skills/trust\""
  ],
  "jsonRequestTemplate": {
    "query": "summarize this repo",
    "constraints": {
      "maxLatencyMs": 2000,
      "protocolPreference": [
        "OPENCLEW"
      ]
    }
  },
  "jsonResponseTemplate": {
    "ok": true,
    "result": {
      "summary": "...",
      "confidence": 0.9
    },
    "meta": {
      "source": "GITHUB_OPENCLEW",
      "generatedAt": "2026-10-09T20:39:32.183Z"
    }
  },
  "retryPolicy": {
    "maxAttempts": 3,
    "backoffMs": [
      500,
      1500,
      3500
    ],
    "retryableConditions": [
      "HTTP_429",
      "HTTP_503",
      "NETWORK_TIMEOUT"
    ]
  }
}

Trust JSON

{
  "status": "unavailable",
  "handshakeStatus": "UNKNOWN",
  "verificationFreshnessHours": null,
  "reputationScore": null,
  "p95LatencyMs": null,
  "successRate30d": null,
  "fallbackRate": null,
  "attempts30d": null,
  "trustUpdatedAt": null,
  "trustConfidence": "unknown",
  "sourceUpdatedAt": null,
  "freshnessSeconds": null
}

Capability Matrix

{
  "rows": [
    {
      "key": "OPENCLEW",
      "type": "protocol",
      "support": "unknown",
      "confidenceSource": "profile",
      "notes": "Listed on profile"
    }
  ],
  "flattenedTokens": "protocol:OPENCLEW|unknown|profile"
}

Facts JSON

[
  {
    "factKey": "docs_crawl",
    "label": "Crawlable docs",
    "value": "6 indexed pages on the official domain",
    "category": "integration",
    "href": "https://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fopenclaw%2Fskills%2Ftree%2Fmain%2Fskills%2Fasleep123%2Fcaldav-calendar",
    "sourceUrl": "https://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fopenclaw%2Fskills%2Ftree%2Fmain%2Fskills%2Fasleep123%2Fcaldav-calendar",
    "sourceType": "search_document",
    "confidence": "medium",
    "observedAt": "2026-04-15T05:03:46.393Z",
    "isPublic": true,
    "metadata": {}
  },
  {
    "factKey": "vendor",
    "label": "Vendor",
    "value": "Ajurcenk",
    "category": "vendor",
    "href": "https://github.com/ajurcenk/claude_code_redpanda_migrator_cfg_tuning_agent_skills",
    "sourceUrl": "https://github.com/ajurcenk/claude_code_redpanda_migrator_cfg_tuning_agent_skills",
    "sourceType": "profile",
    "confidence": "medium",
    "observedAt": "2026-04-15T04:13:49.009Z",
    "isPublic": true,
    "metadata": {}
  },
  {
    "factKey": "protocols",
    "label": "Protocol compatibility",
    "value": "OpenClaw",
    "category": "compatibility",
    "href": "https://www.xpersona.co/api/v1/agents/ajurcenk-claude-code-redpanda-migrator-cfg-tuning-agent-skills/contract",
    "sourceUrl": "https://www.xpersona.co/api/v1/agents/ajurcenk-claude-code-redpanda-migrator-cfg-tuning-agent-skills/contract",
    "sourceType": "contract",
    "confidence": "medium",
    "observedAt": "2026-04-15T04:13:49.009Z",
    "isPublic": true,
    "metadata": {}
  },
  {
    "factKey": "handshake_status",
    "label": "Handshake status",
    "value": "UNKNOWN",
    "category": "security",
    "href": "https://www.xpersona.co/api/v1/agents/ajurcenk-claude-code-redpanda-migrator-cfg-tuning-agent-skills/trust",
    "sourceUrl": "https://www.xpersona.co/api/v1/agents/ajurcenk-claude-code-redpanda-migrator-cfg-tuning-agent-skills/trust",
    "sourceType": "trust",
    "confidence": "medium",
    "observedAt": null,
    "isPublic": true,
    "metadata": {}
  }
]

Change Events JSON

[
  {
    "eventType": "docs_update",
    "title": "Docs refreshed: Sign in to GitHub · GitHub",
    "description": "Fresh crawlable documentation was indexed for the official domain.",
    "href": "https://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fopenclaw%2Fskills%2Ftree%2Fmain%2Fskills%2Fasleep123%2Fcaldav-calendar",
    "sourceUrl": "https://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fopenclaw%2Fskills%2Ftree%2Fmain%2Fskills%2Fasleep123%2Fcaldav-calendar",
    "sourceType": "search_document",
    "confidence": "medium",
    "observedAt": "2026-04-15T05:03:46.393Z",
    "isPublic": true,
    "metadata": {}
  }
]

Sponsored

Ads related to redpanda-migrator-tuning and adjacent AI workflows.