Awesome MCPBrowser Automation

just-every/mcp-read-website-fast

⭐ 161 TypeScript repository created 2025-06-11

mcp-read-website-fast is a Model Context Protocol server for turning web pages into clean Markdown that an LLM can read cheaply. Its stated motivation is that existing MCP crawlers are slow and return whole pages, forcing the model to spend tokens parsing noise. This server fetches pages locally, strips boilerplate with Mozilla Readability, the same extraction engine behind Firefox Reader View, and converts the remaining content to Markdown using Turndown with GitHub Flavored Markdown support, preserving links so the output can feed knowledge graphs. The core crawling and conversion logic now lives in the separate @just-every/crawl package. The MCP surface is small: one tool, read_website, takes a required HTTP or HTTPS url and an optional pages count controlling how many pages to crawl, defaulting to one and capped at 100. Two resources are exposed, read-website-fast://status for cache statistics and read-website-fast://clear-cache to empty the cache directory. Operationally it caches responses on disk under SHA-256 hashed URL keys, respects robots.txt and rate limits by default, fetches concurrently with configurable depth, and uses a stream-first design to keep memory low; optional chunking prepares output for downstream processing. The server starts quickly through the official MCP SDK with lazy loading, and wraps itself in an auto-restart supervisor that handles crashes, unhandled exceptions and rejected promises with exponential backoff, up to ten attempts per minute, while shutting down cleanly on SIGINT and SIGTERM. A CLI mirrors the same functionality with flags for pages, concurrency, robots.txt bypass, cross-origin crawling, user agent, cache directory, timeout and output as markdown, JSON or both. Installation is a single command for Claude Code, VS Code, Cursor and JetBrains IDEs, or raw JSON for any MCP client. JavaScript-rendered sites are not supported. MIT licensed.

https://github.com/just-every/mcp-read-website-fast

mcpmcp-serverweb-scrapingmarkdownreadabilitycrawlertypescript

Also in Browser Automation

microsoft/playwright-mcp

Playwright MCP is an MCP server that enables LLMs to automate and interact with web browsers using structured accessibility snapshots for efficient and deterministic browser automation.

alibaba/page-agent

Page Agent is an in-page JavaScript GUI agent that enables natural language control of web interfaces, offering easy integration without browser extensions or headless browsers.

Skyvern-AI/skyvern

Skyvern automates browser-based workflows using large language models and computer vision, providing a robust and scalable web automation solution that integrates with the Model Context Protocol (MCP).

firecrawl/firecrawl-mcp-server

Firecrawl MCP Server is an MCP server implementation that adds advanced web scraping, crawling, and search capabilities to LLM clients like Cursor and Claude, enabling enhanced data extraction and research functionalities.

AgentDeskAI/browser-tools-mcp

BrowserTools MCP is a powerful browser monitoring and interaction tool that leverages the Model Context Protocol to enable AI-powered applications to capture and analyze browser data directly within MCP-compatible IDEs.

BrowserMCP/mcp

Browser MCP is an MCP server and Chrome extension that enables AI applications to automate and control your browser locally using your existing browser profile for privacy, speed, and stealth.

apify/actors-mcp-server

Apify MCP Server is an MCP protocol server implementation that enables AI assistants to interact with Apify Actors for data extraction, web scraping, and automation tasks through a standardized protocol.

agent-infra/sandbox

agent-infra/sandbox is an all-in-one sandbox environment combining Browser, Shell, File, MCP, and VSCode Server in a single Docker container, providing a unified, secure, and agent-ready platform for AI agent development and testing.