Awesome MCP › Other MCP Servers

pskill9/website-downloader

⭐ 157 JavaScript added to this list on 2025-05-06 repository created 2024-12-23

Website Downloader MCP Server wraps the wget utility in a single MCP tool, download_website, so a model can retrieve a whole site rather than one page at a time. The tool takes a required url and optional parameters: outputPath for the destination directory, defaulting to the current directory, and depth to bound recursive descent, where zero fetches only the given page, one follows direct links, and the default is unlimited. wget is invoked in mirroring mode, so the site's directory structure is preserved on disk and internal links are converted to relative paths that resolve against the local copy — the downloaded site is browsable offline rather than a pile of disconnected HTML. The server is a small JavaScript project whose only prerequisite is wget being installed and on PATH; the README gives installation commands for macOS via Homebrew, Debian and Red Hat family Linux, and Windows via Chocolatey or a prebuilt binary. Because it delegates entirely to wget, it inherits both wget's robustness and its limitations, notably no JavaScript rendering, so single-page applications will not mirror usefully. The audience is people who need an offline copy of documentation or a reference site for later analysis, where a model can then read the local files instead of making repeated network requests.

https://github.com/pskill9/website-downloader

mcpwgetwebsite-mirroringscrapingofflinejavascriptdownload