Hello, I'm looking for a way to scrape data from Similarweb extension for about 3,000 websites per day. Is there a way to do this? I wanted to use Similarweb's API if they offer an affordable price for two metrics. I've contacted them, but they haven't responded yet.
How to scrape data from Similarweb extension
- Thread starter mrellon
- Start date
-
- Tags
- scrape similarweb
MiSparrow
Junior Member
- Jul 29, 2024
- 108
- 47
If the Similarweb API turns out to be too expensive, you could consider scraping data from the extension, but that might violate their terms of service. An alternative is to check other analytics services like Ahrefs or Semrush—maybe they have better pricing options. Another hack is to look for ready-made scripts on GitHub—someone might have already solved this problem
- Feb 28, 2010
- 5,501
- 4,420
You could hire a python developer from Fiverr to write you a quick scraper. It will get the job done and you wont have to pay any fees
- Aug 9, 2017
- 5,576
- 6,862
Similarweb is very protective of their data, and make it pretty hard to scrape at scale - good proxies and cloudflare bypassing is generally needed. I've had luck with some third party APIs - take a look through what's on rapidapi: https://rapidapi.com/search?term=similarweb&sortBy=ByRelevance
jackasspeter
BANNED
- Dec 15, 2023
- 107
- 38
Scraping the Similarweb extension directly might be hard due to limitations. If their API is too expensive, you could look into alternative data providers or use browser automation tools like Selenium or Puppeteer to extract the data. Have you considered any other sources for traffic insights?