Smart Web
Give agents web search, smartfetch URL retrieval, crawl, and docs export without bolting on separate scrapers per project.
Overview
smart-web is an Idea-phase MCP server that provides web search, URL smartfetch, crawl, and docs export for agent-driven research.
What is this MCP server?
- Web search, direct-URL fetch, crawl, and docs export in one MCP
- smartfetch optimized for pulling content from URLs
- npm package smart-web-mcp 0.9.2 with stdio transport
- From jojo-labs/smart-web on GitHub
- Version 0.9.2 (npm identifier smart-web-mcp)
- Repository: github.com/jojo-labs/smart-web
What problem does it solve?
Agents hallucinate or stall when you need fresh pages, search results, or exported docs but only have static repository context.
Who is it for?
Indie builders who want a single npm MCP for research, competitor pages, and doc harvesting during early product work.
Skip if: Flows that need authenticated browser sessions, heavy form interaction, or enterprise compliance-reviewed crawling policies out of the box.
What do I get? / Deliverables
After adding smart-web-mcp, your agent can search the web, fetch URLs, crawl sites, and export documentation through MCP tools.
- Agent-accessible web search and URL fetch tools
- Crawl and docs export output for downstream prompts or files
- Reduced one-off scripting for public web retrieval
Recommended MCP Servers
Journey fit
Discovery and competitive research are the first canonical home; the same server later supports doc ingestion during build and citation-friendly research for AI visibility. Research is the primary shelf because smart-web’s headline capabilities are search and fetch for grounding decisions before you commit to build.
How it compares
Retrieval-focused web MCP, not a full browser-task automation suite like web-task-api.
Common Questions / FAQ
Who is Smart Web for?
Solo builders using MCP agents who need search and fetch during research and documentation workflows without maintaining custom scrapers.
When should I use Smart Web?
During idea and validate research, or whenever the agent must read live URLs, crawl sites, or export docs into your project context.
How do I add Smart Web to my agent?
Install Smart Web-mcp from npm (0.9.2), configure the stdio MCP entry in Claude Code or Cursor, and invoke search, smartfetch, crawl, or export tools as needed.