Floccer
Regular Member
- Mar 2, 2019
- 365
- 163
I would say you need to test it. If you get bot check (the captcha window) then you need to slow down, use proxies or use a captcha solver.
[CODE] People Also Ask Scraping with Python [Upgraded code from iam_ironman]
- Thread starter Ramazan
- Start date
- Jun 9, 2020
- 6,574
- 3,265
I test with 30 keywords.
Didn't got any issues yet.
But it takes 1 minute per keyword. So if I put 60 keywords then it would take 60 mints to process that.
Floccer
Regular Member
- Mar 2, 2019
- 365
- 163
Multiprocessing and proxy per thread will speed this process. So with even 2 threads 60 keywords could take 30mins.
- Jun 9, 2020
- 6,574
- 3,265
How do I do with multiprocessing?
Floccer
Regular Member
- Mar 2, 2019
- 365
- 163
You would need to change the code to support multiprocessing. I don't have enough knowledge to do that
- Jun 9, 2020
- 6,574
- 3,265
Alright. I will check it out.
Bugfisch
Regular Member
- Nov 5, 2021
- 363
- 284
Just try - worst thing that can happen is, that you will get a captcha
If something works without proxies - and you don't have a problem, someone knows your IP - don't use proxies. They are expensive when using good ones and they will slow things down.
- Jun 9, 2020
- 6,574
- 3,265
That's what i am doing. TestingJust try - worst thing that can happen is, that you will get a captcha
If something works without proxies - and you don't have a problem, someone knows your IP - don't use proxies. They are expensive when using good ones and they will slow things down.
Thanks BTW.
