AgentUni
Web Search & Browsing

Scrape-LE

by @nolindnaidoo / v2.2.5

Analyse robots.txt content and report whether a path may be crawled.

Install

npm / stdio

npx -y scrape-le-mcp

Client config (Claude Desktop, Cursor, Windsurf and most MCP clients)

{
  "mcpServers": {
    "io-github-nolindnaidoo-scrape-le": {
      "command": "npx",
      "args": [
        "-y",
        "scrape-le-mcp"
      ]
    }
  }
}

Source: official MCP Registry record · registry name io.github.nolindnaidoo/scrape-le · published 2026-08-14 · updated 2026-08-14. Not an endorsement; review the code before connecting it to anything sensitive.

Similar

More Web Search & Browsing servers

Browse category

AnyAPI

Remote

@getanyapi-com / Web Search & Browsing

Hundreds of scraping & data APIs through one key. USD pay-per-request, normalized schemas, failover.

npmDocker

HasData Google Search (SERP)

Remote

com.hasdata / Web Search & Browsing

Google SERP as JSON: organic, AI Overview, People Also Ask, AI Mode, news, shopping. No Cloud setup.

npmPyPI

HasData Web Scraping

Remote

com.hasdata / Web Search & Browsing

Fetch any public web page through managed proxies, with optional JS rendering and extraction rules.

npmPyPI

SERP Agent SEO

Remote

com.serp-agent / Web Search & Browsing

Full-cycle SEO automation for AI agents: technical audits, SEO articles, machine-readable pricing.

npm

mcp-server

Remote

io.tooltrace / Web Search & Browsing

Web tools for AI agents: scrape pages to Markdown, audit SEO, detect tech stacks, check sitemaps

npm

Slack MCP Server

Remote

@jtalk22 / Web Search & Browsing

Catch up on Slack without reading it. Unreads, threads, search. Browser-session or hosted OAuth.

npm