[Code] Scrape Google PAA Using Python + Requests
- Thread starter iam_ironman
- Start date
squeak
Newbie
- Dec 25, 2009
- 19
- 7
When scraping the "People Also Ask" element on Google, would you:
1. Click on the 2nd box so that more questions/answers appear, then click on the next drop-down, etc.
Like this -
OR
2. Take the four or five questions and do a separate search for each of them, extracting the questions/answers from each search.
#1 requires using a headless browser, so is a little more difficult whereas #2 is quick and very easy.
#1 seemed to give a better flow of questions/answers whereas #2 to have a lot of repetition.
Do you have any views on whether #2 is OK, or has to be #1?
1. Click on the 2nd box so that more questions/answers appear, then click on the next drop-down, etc.
Like this -
2. Take the four or five questions and do a separate search for each of them, extracting the questions/answers from each search.
#1 requires using a headless browser, so is a little more difficult whereas #2 is quick and very easy.
#1 seemed to give a better flow of questions/answers whereas #2 to have a lot of repetition.
Do you have any views on whether #2 is OK, or has to be #1?
SyntaxSurge
Power Member
- Feb 6, 2023
- 537
- 150
why it's not working anymore, it returns an empty array: []
SyntaxSurge
Power Member
- Feb 6, 2023
- 537
- 150
oh google's blocking my request