- Sep 25, 2013
- 4,705
- 2,701
Has anyone managed to scrape bing lately using scripts? It seems to only grab results from the first page exclusively even if you try to do pagination (going to the next page)
So even if u go to page 10 the script will still only get the first page results because Bing detects you as a "bot".
I'm using python to code my scripts, I've tried requests, I've tried playwright and the only one that actually works is running playwright but without being headless. Otherwise every other option seems to be triggering the anti botting measures of Bing.
So even if u go to page 10 the script will still only get the first page results because Bing detects you as a "bot".
I'm using python to code my scripts, I've tried requests, I've tried playwright and the only one that actually works is running playwright but without being headless. Otherwise every other option seems to be triggering the anti botting measures of Bing.