Any connector for claude or solution that allows Claude to crawl and scrape reddit threads forums?

cockus

Power Member
Joined
May 6, 2017
Messages
550
Reaction score
50
Hey,

Are there any connector for claude or solution that allows Claude to crawl and scrape reddit threads forums? Currently im not able to crawl reddit with Firecrawl MCP connector for Claude.
 
Firecrawl usually fails on Reddit because they block most server side crawlers pretty hard.

Easiest fix is just grab one of the dedicated Reddit MCP servers (the RSS-based ones work without any API key) and add it to Claude Desktop or Claude Code.
 
the rss trick above works, add .json to the end of any reddit thread url too, reddit still serves the whole thread as json without login and claude reads that fine. i do it with a 10 line fetch script as a tool, no mcp needed, just rate limit it to one request every few seconds or you get blocked for an hour
 
Back
Top