data.similarweb.com API blocked any free alternative for website traffic?

[zamlamonia]

Hey guys, I was using this public endpoint to get traffic data:



https://data.similarweb.com/api/v1/data?domain=example.com

Recently it stopped working — just returns a CloudFront block. Tried different IPs, no luck.
Looking for:

1. A fix/workaround to keep using this endpoint.
2. Or a reliable free Public API that gives website traffic metrics or any websites info.

Anyone solved this or knows a good alternative?

 

[Steptoe]

Similarweb have always been pretty precious about people scraping their data. There are still some scrapers on RapidAPI that work, but you'll have to pay for anything more than a handful of queries (eg: https://rapidapi.com/watermark/api/similarweb-traffic/pricing )

If you're ok with scripting basic requests you can target Ahrefs' public traffic checker here: https://ahrefs.com/traffic-checker/
You just need a decent amount of proxies and a captcha solver capable of solving Turnstile captchas.

 

[zamlamonia]

Similarweb have always been pretty precious about people scraping their data. There are still some scrapers on RapidAPI that work, but you'll have to pay for anything more than a handful of queries (eg: https://rapidapi.com/watermark/api/similarweb-traffic/pricing )

If you're ok with scripting basic requests you can target Ahrefs' public traffic checker here: https://ahrefs.com/traffic-checker/
You just need a decent amount of proxies and a captcha solver capable of solving Turnstile captchas.

I was using this API in Google Colab to perform bulk search analysis with simple loop script
I don't know how to handle CAPTCHAs and proxies.

What I want: I have a list of websites and I want to see which ones are the most visited. For website analysis at scale, what free tools do you suggest for bulk metrics? Any metrics

 

[Steptoe]

What I want: I have a list of websites and I want to see which ones are the most visited. For website analysis at scale, what free tools do you suggest for bulk metrics? Any metrics

Noone is in the business of giving those metrics away for free, not in bulk anyway. You'll either need to find an unprotected endpoint (like you did with similarweb by the looks of it), scale down your data demand, or start paying for an API. What sort of numbers are you looking at regarding number of websites to check? The API I listed for example gives 100 free uses per month, but there may well be others with a more generous free offering - have a look: https://rapidapi.com/search?term=similarweb&sortBy=ByUpdatedAt

 

[zamlamonia]

Noone is in the business of giving those metrics away for free, not in bulk anyway. You'll either need to find an unprotected endpoint (like you did with similarweb by the looks of it), scale down your data demand, or start paying for an API. What sort of numbers are you looking at regarding number of websites to check? The API I listed for example gives 100 free uses per month, but there may well be others with a more generous free offering - have a look: https://rapidapi.com/search?term=similarweb&sortBy=ByUpdatedAt

Yeah that’s the point. I’m looking for endpoints, as you mentioned. Where can I find this type of endpoint, like the ones we have with Pytrends(googletrends) and SimilarWeb? Do you know any, or a place where I might look?

I have bulk searches for mixed data (just a first filter), so I need a lot of free endpoints like I had with SimilarWeb — ones that let me run thousands of searches in a few minutes with no limitations and return CSV data. This must work only in a Colab script.

 

[zamlamonia]

Looks like the endpoint is behind a protection layer now cloud‑front blocking usually means access restrictions changed.

yes this happens in last three week before it was working for many years

 

[Storms-21]

that endpoint is now blocked. For a free alternative, you might try the Similarweb “Free Website Traffic” API (limited usage) or check out Ahrefs Webmaster Tools for site metrics.

 

[Steptoe]

Yeah that’s the point. I’m looking for endpoints, as you mentioned. Where can I find this type of endpoint, like the ones we have with Pytrends(googletrends) and SimilarWeb? Do you know any, or a place where I might look?

I have bulk searches for mixed data (just a first filter), so I need a lot of free endpoints like I had with SimilarWeb — ones that let me run thousands of searches in a few minutes with no limitations and return CSV data. This must work only in a Colab script.

Those sorts of endpoints tend not to be meant for public consumption, so it's doubtful that if anyone has found access to one they publicly disclose it (unless they're after bug bounties). I wish you good luck in your search.

 

[zamlamonia]

ty brother

Those sorts of endpoints tend not to be meant for public consumption, so it's doubtful that if anyone has found access to one they publicly disclose it (unless they're after bug bounties). I wish you good luck in your search.

 

[theusualkeysersoze]

Well, generally, for anything you wanna use repeatedly for free, make your life easy, get an antidetect, learn how to set them up, some decent proxy and call it a day, life time free trials

 

[zamlamonia]

Well, generally, for anything you wanna use repeatedly for free, make your life easy, get an antidetect, learn how to set them up, some decent proxy and call it a day, life time free trials

do u have any example brother ? idint get the idea how to use antidetect where i find em

 

[theusualkeysersoze]

do u have any example brother ? idint get the idea how to use antidetect where i find em

Well I cant be advertising for anyone and its not super simple, but check my post history, I have made one thread about proxies and one about anti detects, I would advise to read these before moving forward in the frist place.

 

[Noroc]

I have just tested and it's working as expected.
Have you ever tried to use a proxy?

 

[alex_zen]

I used that endpoint too — looks like Similarweb locked it behind CloudFront and it’s not just an IP issue.
For free alternatives there’s no 1:1 for traffic, but you can combine things like BuiltWith, Wappalyzer and Google Trends for basic signals

 

[bhseoworld]

chasing free public apis for bulk traffic data in 2026 is a losing battle mate . similarweb nuked that public route because too many people were hammering it for free . everyone is behind heavy cloudfront / datadome setups now
if u need to filter a massive list of domains without paying for enterprise seats , here is how i handle it
the extension endpoint play
extensions for semrush or similarweb often hit different , less-protected api endpoints compared to the main web ui . they have to serve millions of passive users so the filters are sometimes more lenient . open ur browser devtools , look at the network traffic while the extension loads , and try to replicate those requests in ur colab script . u will still need residential proxies tho
keywords as a proxy
if u just need to know which ones are most visited , stop looking for raw traffic numbers . look for ranking keyword counts . data from spyfu or even smaller aggregators like keywords everywhere is way cheaper to scrape and has a high correlation with actual traffic . it’s enough for a first-pass filter
the 'search volume hack
for a zero-budget way to sort 10k domains , check the brand search volume for each domain name . use a low-cost api to pull the monthly search volume for the domain string itself . if people are googling the brand , the site has traffic . simple as that .
scaling this in colab is a headache cuz google cloud ips are flagged by cloudfront instantly . u strictly need a proxy rotation middleware if u want to run thousands of hits without the 403 blocks . gl with the scrape

 

[Lekaso]

yeah i builded some stuff already u can check my journey