1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Python Scraping I HATE Distil Networks

Discussion in 'Other Languages' started by BlawkEyes, Feb 24, 2015.

  1. BlawkEyes

    BlawkEyes Newbie

    Joined:
    Feb 24, 2015
    Messages:
    1
    Likes Received:
    0
    Here is the situation.

    I'm looking to grab a few card prices off of tcgplayer
    but I get blocked eventually.

    Code:
    from selenium import webdriver
    driver = webdriver.Firefox()
    driver.get("google url")
    
    1. I open up a new firefox window with selenium using above code.

    2. I browse using a normal firefox window as well ( opened via firefox shortcut)

    3. if I browse (by hand mind you) long enough from any one ip my selenium browser starts getting blocked as a "bot" (suspicious activity detected page redirect) I HATE YOU DISTIL NETWORKS

    4. I may still browse tcgplayer with no problems using the firefox normal shortcut


    **Side note** to get selenium blocked from a specific IP all it takes are a few quick url openings from my code, after that its blocked every time
    if anyone can find out why this happens I will forever remember your name. (I know right)
     
  2. jazzc

    jazzc Moderator Staff Member Moderator Jr. VIP

    Joined:
    Jan 27, 2009
    Messages:
    2,569
    Likes Received:
    11,034
    Occupation:
    Pusillanimous Knitter
    Location:
    Buenos Aires
    Throttle your clicks then (i.e. put a delay, like a human).