Awesome MCP › Desktop Automation
Automation MCP is a Model Context Protocol (MCP) server designed specifically for macOS to provide AI models with extensive desktop automation capabilities. This project enables AI assistants to interact with the macOS desktop environment in a comprehensive manner, including controlling the mouse, keyboard, screen, and windows. The server supports mouse actions such as clicking, moving, scrolling, dragging, and button control, allowing precise and varied mouse interactions. Keyboard input capabilities include typing text, sending key combinations, and executing system shortcuts, enabling full keyboard automation. In addition to input control, Automation MCP offers screen capture and analysis features. It can take screenshots of the full screen, specific regions, or individual windows, and analyze screen content by detecting colors at any pixel and waiting for specific images to appear using template matching. The server also supports visual screen region highlighting. Window management is another key feature, allowing the listing of all open windows, retrieving the active window, and controlling windows by focusing, moving, resizing, or minimizing them. These capabilities make it possible for AI models to manage the desktop environment dynamically. The project requires macOS permissions for Accessibility and Screen Recording to function fully, ensuring it can control input devices and capture screen content securely. It integrates smoothly with the furi runtime environment, simplifying installation and startup, but can also be run independently using the Bun runtime. Automation MCP is ideal for developers and researchers working on AI assistants or automation tools that need to interact with the macOS desktop environment programmatically. It provides a robust and flexible interface for AI-driven desktop automation, enhancing the capabilities of AI models by bridging them with real-world desktop interactions.
https://github.com/ashwwwin/automation-mcp
UI-TARS Desktop is a cross-platform GUI Agent application that uses a vision-language model to enable natural language control of computers with precise visual recognition and real-time feedback, integrating Model Context Protocol tools for advanced multimodal AI-driven automation.
Docker-Android packages Android emulators in Docker with VNC access, ADB control and log sharing for app testing, plus a beta MCP server image that exposes emulator control to AI agents.
Desktop Commander MCP is an MCP server for Claude that integrates AI with terminal control, file system search, and file editing capabilities, enabling advanced desktop automation and development workflows.
Windows-MCP is a lightweight, open-source MCP server that enables seamless integration and automation between AI agents using LLMs and the Windows operating system, supporting a wide range of UI interactions and system controls.
Peekaboo is a macOS-only MCP server and CLI tool that enables AI agents to capture and analyze screenshots with AI vision models for visual question answering and automation.
ios-simulator-mcp is an MCP server enabling AI-driven interaction, control, and inspection of iOS simulators for automated UI testing and quality assurance.
Terminator is an open-source automation tool for Windows that leverages the Model Context Protocol to enable AI-driven desktop and browser automation with high reliability and speed.
CodeRunner is an MCP server that securely executes AI-generated code locally on macOS using Apple's container technology, enabling private and efficient processing of local files with remote LLMs.