solution to ChatGPT being blocked by websites?

[Binkmaster]

I'm using ChatGPT 4, and have been using it to scrap data from a website. Suddenly, it can no longer do so, claiming maybe robots.txt, or IP or user agent problems.

Anyone run into this and have a work around? I was going to create a page with an iframe in it and load the site into that to see if that worked

 

[vccresellerpanel]

most of websites running cloudflare WAF, in such website you can't scrap data automatically

 

[Binkmaster]

hmm, maybe a server side proxy..

 

[flackz]

I'm using ChatGPT 4, and have been using it to scrap data from a website. Suddenly, it can no longer do so, claiming maybe robots.txt, or IP or user agent problems.

Anyone run into this and have a work around? I was going to create a page with an iframe in it and load the site into that to see if that worked

Get a premium proxy.

 

[Upmanaone]

I'm using ChatGPT 4, and have been using it to scrap data from a website. Suddenly, it can no longer do so, claiming maybe robots.txt, or IP or user agent problems.

Anyone run into this and have a work around? I was going to create a page with an iframe in it and load the site into that to see if that worked

 

[Upmanaone]

Am expert in this project kindly contact me now for more discuss

 

[GOOGLEDUCK]

also looking for this solution

 

[Upmanaone]

also looking for this solution

What solution are looking for sir

 

[Binkmaster]

Its frustrating with how useful llms like this are, but now how all the sources of data are going into lock down

 

[Upmanaone]

Its frustrating with how useful llms like this are, but now how all the sources of data are going into lock down

Hello sir

 

[Binkmaster]

I'm a Shopify development expert. I work with businesses like yours to help them build and customize their online stores using Shopify. I have experience with all aspects of Shopify developmentand clocking ads. I can help you build a custom Shopify store that will increase your online sales and improve your customer experience. Are you ready in developing your Shopify store?

you must be a bot lol

 

[medialounge]

Maybe it's a proxy problem, get good one and try again.