Markdown Proxy
Let your coding agent fetch any URL—including login-gated posts and docs—as clean Markdown instead of brittle copy-paste.
Overview
markdown-proxy is an agent skill most often used in Build integrations (also Idea research, Grow content) that turns URLs—including login-heavy pages—into clean Markdown for Claude-style agents.
Install
npx skills add https://github.com/joeseesun/markdown-proxy --skill markdown-proxyWhat is this skill?
- Converts arbitrary URLs to clean Markdown for agent context windows
- Dedicated extraction paths for login-required surfaces: X/Twitter, WeChat, Feishu/Lark docs
- Bilingual project docs (English/中文) for cross-market solo builders
- MIT-licensed qiaomu-markdown-proxy workflow send-URL-get-Markdown
- Five content types called out with tailored fetch handling in README
- 5 dedicated content-type extraction paths mentioned in README
Adoption & trust: 732 installs on skills.sh; 471 GitHub stars; 2/3 security scanners passed (skills.sh audits).
What problem does it solve?
Your agent cannot reliably ingest a link because the page needs login, renders in JS, or paste loses structure.
Who is it for?
Indie builders aggregating Twitter/X threads, Chinese ecosystem docs, or Feishu knowledge bases into agent-driven workflows.
Skip if: Teams that forbid agents from fetching external URLs or pages you can already export as plain Markdown with one click.
When should I use this skill?
When you want to send any URL to Claude and automatically get full Markdown, especially for login-required X, WeChat, or Feishu/Lark pages.
What do I get? / Deliverables
The agent receives structured Markdown from the target URL so you can cite, summarize, or implement without retyping gated content.
- Clean Markdown representation of the source URL
- Agent-ready text for summarization or implementation tasks
Recommended Skills
Journey fit
Spans multiple journey phases - primary shelf plus alternate fits below.
Installing a URL-to-Markdown proxy is wiring agent tooling during product build so Claude/Cursor can ingest live sources in the loop. The skill centers on connecting agents to external pages (X, WeChat, Feishu/Lark), which is integration work rather than frontend UI.
Where it fits
Pull a competitor’s gated Feishu spec into Markdown before you commit to a feature scope.
Wire the proxy so your agent loads RFCs and vendor docs by URL during implementation.
Convert a long X thread into Markdown for editing a newsletter or changelog draft.
Archive WeChat posts from rivals for side-by-side positioning notes in your agent session.
How it compares
Agent-side URL fetch skill—not a generic static-site generator or Prism directory MCP server.
Common Questions / FAQ
Who is markdown-proxy for?
Solo builders using Claude Code, Cursor, or Codex who need full article text from URLs, especially X/Twitter, WeChat, or Feishu/Lark.
When should I use markdown-proxy?
During Idea research to capture competitors, in Build when wiring agent tooling for doc ingestion, and in Grow when repurposing long posts into structured drafts.
Is markdown-proxy safe to install?
It performs network fetches and may handle authenticated sessions—review the Security Audits panel on this page and your own secret handling before enabling.
SKILL.md
READMESKILL.md - Markdown Proxy
MIT License Copyright (c) 2026 joeseesun Permission is hereby granted, free of charge, to any person obtaining a copy of this software and associated documentation files (the "Software"), to deal in the Software without restriction, including without limitation the rights to use, copy, modify, merge, publish, distribute, sublicense, and/or sell copies of the Software, and to permit persons to whom the Software is furnished to do so, subject to the following conditions: The above copyright notice and this permission notice shall be included in all copies or substantial portions of the Software. THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE. # qiaomu-markdown-proxy > Convert any URL to clean Markdown, with built-in support for login-required pages (X/Twitter, WeChat, Feishu/Lark docs, etc.) > 将任意 URL 转为干净的 Markdown，支持需要登录的页面（X/Twitter、微信公众号、飞书文档等）。 **[English](#english) | [中文](#中文)** --- <a name="english"></a> ## English ### Features Send any URL to Claude, and it automatically fetches the full content as Markdown. Five content types have dedicated extraction: | URL Type | Method | Why | |----------|--------|-----| | WeChat Articles (`mp.weixin.qq.com`) | Built-in Playwright script | Anti-scraping protection requires headless browser | | Feishu/Lark Docs (`feishu.cn`, `larksuite.com`) | Built-in Feishu API script | Requires API authentication, auto-converts to Markdown | | YouTube | Dedicated YouTube skill | Video content has its own toolchain | | PDF (remote or local) | Built-in PDF extraction (`extract_pdf.sh`) | Three-method cascade: marker-pdf → pdftotext → pypdf | | All other URLs | Proxy cascade via `fetch.sh`: r.jina.ai → defuddle.md → agent-fetch | Free, no API key, content validation built-in | ### Prerequisites - [ ] [Claude Code](https://docs.anthropic.com/en/docs/claude-code) installed - [ ] **curl** (built-in on macOS/Linux) - [ ] (Optional - WeChat scraping) Python 3.8+ with playwright ```bash pip install playwright beautifulsoup4 lxml playwright install chromium ``` - [ ] (Optional - PDF extraction) One of: - **marker-pdf** (best quality): `pip install marker-pdf` - **pdftotext** (fast): `brew install poppler` - **pypdf** (fallback): `pip install pypdf` - [ ] (Optional - Proxy fallback) [agent-fetch](https://github.com/teng-lin/agent-fetch) ```bash npx agent-fetch --help # No pre-install needed, npx auto-downloads ``` - [ ] (Optional - Feishu docs) Environment variables `FEISHU_APP_ID` and `FEISHU_APP_SECRET` ```bash echo $FEISHU_APP_ID # Verify configured ``` ### Installation ```bash npx skills add joeseesun/qiaomu-markdown-proxy ``` Verify: ```bash ls ~/.claude/skills/qiaomu-markdown-proxy/SKILL.md ``` ### Usage Just send Claude a URL: - "Read this article: https://example.com/post" - "Fetch this tweet: https://x.com/user/status/123456" - "Read this WeChat article: https://mp.weixin.qq.com/s/abc123" - "Convert this Feishu doc to Markdown: https://xxx.feishu.cn/docx/xxxxxxxx" ### Proxy Priority 1. **r.jina.ai** — Most complete content, preserves image links 2. **defuddle.md** — Cleaner output with YAML frontmatter 3. **[agent-fetch](https://github.com/teng-lin/agent-fetch)** — Local tool, no network proxy needed 4. **defuddle CLI** — Local CLI, good for standard web pages ### Feishu/Lark Document Support Built-in `fetch_feishu.py` script fetches documents via Feishu Open API and auto-converts to Markdown: - Supports new docs (docx), legacy docs (doc), and wiki pages - Auto-parses document blocks into Markdown format - Supports headings, lists, code bloc