import requestsScrapeops are still my goto service for bypassing Cloudflare when I'm scraping, and should be cheaper than BrightData (pretty much everything is!)
https://scrapeops.io/docs/proxy-aggregator/advanced-functionality/anti-bot-bypass/https://scrapeops.io/web-scraping-playbook/how-to-bypass-cloudflare/#option-5-smart-proxy-with-cloudflare-built-in-bypass
Dunno where scraperapi.com comes into it, the service I recommended was scrapeops.io.import requests
payload = { 'api_key': 'xxx', 'url': 'xxx', 'premium' : 'true' }
r = requests.get('https://api.scraperapi.com/', params=payload)
print(r.text)
Request failed. You will not be charged for this request. Please make sure your url is correct and try the request again. If this continues to happen, please contact [email protected]. The domain may be protected, please try adding the premium=true OR ultra_premium=true parameter to your request.
Is it a limitation of the trial? I sent them an email already but I haven't gotten any replies yet.
EDIT: I'll try following the guide you sent me and see if that works.
I must've clicked something wrong, I ended up there somehow trying to register for scrapeops.io. I'll take a look, thank you!Dunno where scraperapi.com comes into it, the service I recommended was scrapeops.io.