Is Scraping dangerous? Should use VPS for that?

[SeoIsArt]

SUppose I want to scrape some infos from an online directory, then place it on my website. Is it dangerous and could it lead to any problems? Should I use VPS in order to do that? Thanks.

 

[rdp.monster]

The only thing you can risk is having your IP blacklisted, but you're not risking much. Most of the big sites get scrapped

 

[SeoIsArt]

The only thing you can risk is having your IP blacklisted, but you're not risking much. Most of the big sites get scrapped

Thx. Can they find out who was scraping ?

 

[sirbankwells]

everyone does should be good

 

[akaseo]

SUppose I want to scrape some infos from an online directory, then place it on my website. Is it dangerous and could it lead to any problems? Should I use VPS in order to do that? Thanks.

Vps is good using that you can scrape 24 x 7

 

[havor99]

Which scraper for wordpress is the best ?

 

[captchakiller]

It's not risky at all however I do suggest using proxies so that your ip will not be blacklisted.

 

[MRDon7]

Scraping is NOT dangerous
Start slow and you will be fine!

 

[rdp.monster]

Thx. Can they find out who was scraping ?

Not directly the guy but the IP if you're using the same IP to scrap. But, you can scrap with residential proxies haha

 

[Algo]

It depends on which website you are trying to scrape but generally speaking use a proxy when you're scrapping to avoid getting restricted or banned.

 

[Siddhant654321]

Use proxy (rotating one) and you should be good since your IP will be safe from getting blacklisted. There are no other risks involved and VPS is not necessary, although it does give you a competitive edge because you can scrape 24/7

 

[___main____]

To begin with, scraping is not illegal. However, some websites will try and block you from harvesting their data. Most often than not, you need two things to successfully scrape lots of data:
1. A stealthy browser
2. Some good proxies

Secondly, I would never use the exact same content I scraped on my own website. Try and parse that data and make it your own before publishing it.

 

[qdza]

Use 4g mobile proxies with rotation, they can't blacklist them

P.s
Someone can suggest some good tutorial about scraping and stuff. I have 10 mobile proxies I want to use them all

 

[___main____]

Use 4g mobile proxies with rotation, they can't blacklist them

P.s
Someone can suggest some good tutorial about scraping and stuff. I have 10 mobile proxies I want to use them all

I wouldn't say there a 'good tutorial about scraping and stuff'. It really depends on your goal. If you want to test out your proxies, try implementing this - https://github.com/mihneamanolache/puppeteer-extra-amazon-captcha - puppeteer extra plugin and scrape amazon listings. I'd say practice makes perfect.

 

[liyong601c]

No, you worry too much, using proxies will be fine

 

[qdza]

I wouldn't say there a 'good tutorial about scraping and stuff'. It really depends on your goal. If you want to test out your proxies, try implementing this - https://github.com/mihneamanolache/puppeteer-extra-amazon-captcha - puppeteer extra plugin and scrape amazon listings. I'd say practice makes perfect.

yeah, ok for testing, but if for selling on internet, is there any rules?

 

[___main____]

but if for selling on internet, is there any rules?

Not necessarily..

 

[qdza]

With scraping can earn huge money?

 

[___main____]

With scraping can earn huge money?

Yes, data seems to be the new gold.

 

[qdza]

I'm interested, I want to learn more about scraping, where to start?