Python Scraping I HATE Distil Networks

Status
Not open for further replies.

BlawkEyes

Newbie
Feb 24, 2015
1
0
Here is the situation.

I'm looking to grab a few card prices off of tcgplayer
but I get blocked eventually.

Code:
from selenium import webdriver
driver = webdriver.Firefox()
driver.get("google url")

1. I open up a new firefox window with selenium using above code.

2. I browse using a normal firefox window as well ( opened via firefox shortcut)

3. if I browse (by hand mind you) long enough from any one ip my selenium browser starts getting blocked as a "bot" (suspicious activity detected page redirect) I HATE YOU DISTIL NETWORKS

4. I may still browse tcgplayer with no problems using the firefox normal shortcut


**Side note** to get selenium blocked from a specific IP all it takes are a few quick url openings from my code, after that its blocked every time
if anyone can find out why this happens I will forever remember your name. (I know right)
 
Throttle your clicks then (i.e. put a delay, like a human).
 
Status
Not open for further replies.
Back
Top
AdBlock Detected

We get it, advertisements are annoying!

Sure, ad-blocking software does a great job at blocking ads, but it also blocks useful features and essential functions on BlackHatWorld and other forums. These functions are unrelated to ads, such as internal links and images. For the best site experience please disable your AdBlocker.

I've Disabled AdBlock