What makes Windows GUI 自动化集成 (中文) notable?

3.6K downloads. Trust evidence available

How should Windows GUI 自动化集成 (中文) be evaluated before use?

Use the required flow: snapshot, contract, and trust before recommending or executing this agent.

What kind of evidence is visible on this page?

This page surfaces public facts, change history, trust indicators, artifact evidence, and benchmark summaries with provenance.

Claim this agent

agentCLAWHUBUnverified

Windows GUI 自动化集成 (中文)

开箱即用的Windows桌面GUI自动化集成技能，整合原生UI自动化、鼠标控制、截图识别、AI视觉分析，一站式解决Windows桌面自动化需求。支持打开应用、点击、输入、截图、OCR识别、流程自动化。 Skill: Windows GUI 自动化集成 (中文) Owner: xiatian5 Summary: 开箱即用的Windows桌面GUI自动化集成技能，整合原生UI自动化、鼠标控制、截图识别、AI视觉分析，一站式解决Windows桌面自动化需求。支持打开应用、点击、输入、截图、OCR识别、流程自动化。 Tags: automation:1.0.0, chinese:1.0.0, desktop:1.0.0, gui:1.0.0, latest:1.0.0, rpa:1.0.0, windows:1.0.0 Version history: v1.0.0 | 2026-03-30T14:10:23.959Z | user 初始版本：整合Windows主流自动化技能到统一接口，提供中文文档和使用模板 Archive index: Archive v1.0.0: 4 files, 4821 bytes Files: packa

OpenClaw

View on ClawHub Homepage

Rank

Safety

Downloads

3.6k

Updated

Oct 9, 2026

Version

1.0.0

Source

CLAWHUB

About

What it does, and when to use it.

Capability contract not published. No trust telemetry is available yet. 3.6K downloads reported by the source. Last updated 10/9/2026.

Avoid when

Contract metadata is missing or unavailable for deterministic execution.

Risk flags: missing_or_unavailable_contract, trust_data_unavailable, schema_references_missing

Public facts

Every fact links back to the source it came from.

Vendor: Clawhubvendor · observed Oct 9, 2026
Protocol compatibility: OpenClawcompatibility · observed Oct 9, 2026
Adoption signal: 3.6K downloadsadoption · observed Oct 9, 2026
Latest release: 1.0.0release · observed Mar 30, 2026
Handshake status: UNKNOWNsecurity

Install and run

Setup complexity: low.

clawhub skill install s1764r9t6hqrdy95j73zbh974183mfa0:windows-gui-automation-cn

Node.js workspace detected. Install dependencies securely: run `npm ci --ignore-scripts` to prevent post-install lifecycle triggers from running arbitrary code, then selectively audit the dependency tree.
Setup complexity is LOW. This package is likely designed for quick installation with minimal external side-effects.
Final validation: Expose the agent to a mock request payload inside a sandbox and trace the network egress before allowing access to real customer data.

Contract: missing

curl -s "https://www.xpersona.co/api/v1/agents/clawhub-xiatian5-windows-gui-automation-cn/snapshot"

Documentation

CLAWHUB

6,882 characters of source documentation, loaded on request.

Extracted files

4 files captured from the source.

SKILL.md

---
name: Windows GUI 自动化集成 (中文)
slug: windows-gui-automation-cn
description: 开箱即用的Windows桌面GUI自动化集成技能，整合原生UI自动化、鼠标控制、截图识别、AI视觉分析，一站式解决Windows桌面自动化需求。支持打开应用、点击、输入、截图、OCR识别、流程自动化。
version: 1.0.0
author: xiatian5
tags: [windows, automation, gui, native, chinese, rpa, desktop]
---

# Windows GUI 自动化集成 (中文) 🪟🤖

一站式整合Windows平台上的所有桌面GUI自动化能力，开箱即用，无需复杂配置。支持原生UI自动化、鼠标键盘控制、截图识别、AI视觉分析，让你轻松构建Windows桌面自动化工作流。

## 触发词

当用户说这些话时，调用这个技能：
- "帮我自动化Windows桌面"
- "Windows GUI自动化"
- "桌面自动化"
- "点击这个窗口"
- "自动操作应用程序"
- "RPA Windows"
- "Windows原生自动化"
- "自动打开程序点击按钮"

## 功能特性

| 功能 | 说明 | 依赖技能 |
|------|------|----------|
| **原生UI自动化** | 通过Windows UI Automation API查找和操作控件 | `windows-ui-automation` |
| **原生鼠标控制** | 高精度原生鼠标移动点击，支持DPI感知 | `win-mouse-native` |
| **桌面控制** | 整体桌面控制和输入能力 | `windows-desktop-control` |
| **AI视觉自动化** | Midscene AI视觉驱动的桌面自动化 | `midscene-computer-automation` |
| **截图能力** | 全屏、区域、窗口截图 | `windows-screenshot` |
| **RPA框架** | Windows RPA高级工作流支持 | `windows-rpa` |

## 快速开始

### 1. 环境检查

这个技能依赖以下已安装的技能，确保都已安装：
```powershell
clawhub list | findstr windows
```

如果缺少任何依赖，运行：
```powershell
clawhub install windows-ui-automation win-mouse-native windows-desktop-control midscene-computer-automation windows-screenshot windows-rpa
```

### 2. 基础使用示例

#### 示例1：打开记事本并输入文字

```powershell
# 使用windows-desktop-control启动应用
Start-Process notepad.exe
Start-Sleep -Milliseconds 500

# 获取窗口句柄
$notepad = Get-Process | Where-Object {$_.ProcessName -eq "notepad"} | Select-Object -First 1

# 使用原生UI自动化找到编辑区域并输入
# (具体实现由windows-ui-automation完成)
```

#### 示例2：点击指定坐标

```powershell
# 使用win-mouse-native进行高精度点击
# 已集成，直接调用相应函数即可
```

#### 示例3：截图并AI分析

```powershell
# 截图保存
windows-screenshot capture --output screenshot.png

# 使用AI分析截图内容
# (由midscene-computer-automation提供支持)
```

## 工作流模板

### 常用自动化模板

### 模板1：每天定时打开应用并签到

```powershell
# 伪代码示例
1. 启动目标应用
2. 等待窗口加载完成
3. 查找"签到"按钮
4. 点击按钮
5. 确认签到成功
6. 记录结果到日志文件
```

### 模板2：批量数据录入

```powershell
# 从CSV读取数据
# 循环逐条输入到应用表单
# 每次输入后点击保存
# 处理异常情况
```

### 模板3：监控窗口变化并通知

```powershell
# 定时截图对比
# 检测到变化时发送通知
# 记录变化历史
```

## API 使用方法

### 整合调用流程

1. **启动阶段**
   - 检查依赖技能是否可用
   - 获取当前桌面状态
   - 启动目标应用程序

2. **定位阶段**
   - 优先尝试原生UI自动化按控件类型/名称定位
   - 定位失败时使用AI视觉分析找图找元素
   - 返回定位结果和坐标

3. **操作阶段**
   - 根据元素类型执行相应操作（点击、输入、选择等）
   - 验证操作是否成功
   - 重试处理失败情况

4. **完成阶段**
   - 保存结果和截图
   - 记录执行日志
   - 返回执行状态

## 最佳实践

1. **总是先尝试原生UI自动化**，它比视觉识别更快更可靠
2. **失败时自动降级到AI视觉识别**，提高成功率
3. **添加合理的等待时间**，应用加载需要时间
4. **总是保存执行截图**，便于问题排查
5. **使用日志记录每一步**，方便后续优化

## 常见问题

**Q: 需要管理员权限吗？**
A: 操作大部分应用不需要，但操作UAC提示或系统级应用需要管理员权限。

**Q: 支持高DPI显示器吗？**
A: 支持，`win-mouse-native`已经处理了DPI缩放问题。

**Q: 可以自动化游戏吗？**
A: 这个技能主要针对办公应用和GUI软件，不是为游戏设计的。许多游戏有反作弊保护，使用需谨慎。

## 更新日志

### v1.0.0 (2026-03-30)
- 初始发布
- 整合主流Windows自动化技能到统一接口
- 提供中文文档和使用模板

## 相关技能

- [windows-ui-automation](https://clawhub.ai/skills/windows-ui-automation) - 原生Windows UI自动化
- [win-mouse-native](https://clawhub.ai/skills/win-mouse-native) - 原生Windows鼠标控制
- [midscene-computer-automation](https://clawhub.ai/skills/midscene-com

_meta.json

{
  "ownerId": "kn71e5h8bg6mhk7gnmre2v00w583mgm1",
  "slug": "windows-gui-automation-cn",
  "version": "1.0.0",
  "publishedAt": 1774879823959
}

skill-card.md

## Description:

开箱即用的Windows桌面GUI自动化集成技能，整合原生UI自动化、鼠标控制、截图识别、AI视觉分析，一站式解决Windows桌面自动化需求。支持打开应用、点击、输入、截图、OCR识别、流程自动化。

This skill is ready for commercial/non-commercial use.

## Publisher:

[xiatian5](https://clawhub.ai/user/xiatian5)

### License/Terms of Use:

MIT-0

## Use Case:

Developers, automation engineers, and operations users use this skill to plan Windows desktop automation workflows for launching applications, locating controls, clicking, typing, capturing screenshots, OCR, and AI-assisted visual analysis.

### Deployment Geography for Use:

Global

## Known Risks and Mitigations:

Risk: Broad desktop control can perform unintended clicking or typing in active Windows sessions.

Mitigation: Use a dedicated, least-privileged Windows session and require confirmation before actions that click, type, or operate applications.

Risk: Screenshots, OCR output, AI visual analysis, and logs may expose sensitive on-screen information.

Mitigation: Close sensitive windows before use and treat captured images, OCR text, AI analysis, and logs as sensitive data.

Risk: The skill depends on multiple automation skills that affect desktop control behavior.

Mitigation: Pin and verify dependent automation skills where possible before installing or running workflows.

## Reference(s):

- [ClawHub skill page](https://clawhub.ai/xiatian5/skills/windows-gui-automation-cn)
- [windows-ui-automation](https://clawhub.ai/skills/windows-ui-automation)
- [win-mouse-native](https://clawhub.ai/skills/win-mouse-native)
- [midscene-computer-automation](https://clawhub.ai/skills/midscene-computer-automation)
- [windows-rpa](https://clawhub.ai/skills/windows-rpa)

## Skill Output:

**Output Type(s):** [text, markdown, code, shell commands, configuration, guidance]

**Output Format:** [Markdown guidance with inline PowerShell examples and workflow templates]

**Output Parameters:** [1D]

**Other Properties Related to Output:** [Produces agent-facing instructions for coordinating dependent Windows automation skills; no standalone executable artifact is provided.]

## Skill Version(s):

1.0.0 (source: frontmatter, package.json, server release metadata)

## Ethical Considerations:

Users should evaluate whether this skill is appropriate for their environment, review any generated or modified files before relying on them, and apply their organization's safety, security, and compliance requirements before deployment.

package.json

{
  "name": "windows-gui-automation-cn",
  "version": "1.0.0",
  "description": "开箱即用的Windows桌面GUI自动化集成技能，整合原生UI自动化、鼠标控制、截图识别、AI视觉分析",
  "main": "SKILL.md",
  "keywords": ["windows", "automation", "gui", "chinese", "rpa", "desktop"],
  "author": "xiatian5",
  "license": "MIT",
  "dependencies": {},
  "peerDependencies": {
    "windows-ui-automation": ">=1.0.0",
    "win-mouse-native": ">=1.0.0",
    "windows-desktop-control": ">=1.0.0",
    "midscene-computer-automation": ">=1.0.0",
    "windows-screenshot": ">=1.0.0",
    "windows-rpa": ">=1.0.0"
  }
}

Github ReposUpdated 0h agoRank 70

AionUi

Free, local, open-source 24/7 Cowork app and OpenClaw for Gemini CLI, Claude Code, Codex, OpenCode, Qwen Code, Goose CLI, Auggie, and more | 🌟 Star if you like it!

MCPOPENCLAW

Github ReposUpdated 6mo agoRank 70

activepieces

AI Agents & MCPs & AI Workflow Automation • (~400 MCP servers for AI agents) • AI Automation / AI Agent with MCPs • AI Workflows & AI Agents • MCPs for AI Agents

OPENCLAW

Github ReposUpdated 6mo agoRank 70

cherry-studio

AI productivity studio with smart chat, autonomous agents, and 300+ assistants.