1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Scraping..

Discussion in 'Black Hat SEO' started by innosoft, Feb 3, 2012.

  1. innosoft

    innosoft Jr. VIP Jr. VIP Premium Member

    Joined:
    Nov 25, 2008
    Messages:
    1,632
    Likes Received:
    639
    Occupation:
    Software Developer, SEO
    Location:
    Office
    Home Page:
    hi,

    what software and proxies you guys use to scrape from google??? i have scrapebox but no luck at all! any ideas?
     
  2. woot123

    woot123 Junior Member

    Joined:
    Jan 10, 2012
    Messages:
    113
    Likes Received:
    27
    I´m using SB too and if you "don´t have luck with SB" then you´re using the wrong footprints ;)
     
  3. innosoft

    innosoft Jr. VIP Jr. VIP Premium Member

    Joined:
    Nov 25, 2008
    Messages:
    1,632
    Likes Received:
    639
    Occupation:
    Software Developer, SEO
    Location:
    Office
    Home Page:
    google easily blocks my proxies and doesnt lets me to scrape! private proxies are good only for few mins and for only single run..
     
  4. shadecc3

    shadecc3 Registered Member

    Joined:
    Jul 9, 2010
    Messages:
    82
    Likes Received:
    6
    Try using different proxies. I'm using 10 private ones from proxyblaze and my SB is going 24/7 with no hiccups. So far, no problems with them.

    -I've tried squid proxies but they would die 3-4 days after and would need them replaced. Replacement would take 1-2 days.
    -Tried from awesomenick but his support was a bit slow and they would die after about 15-20 days and would take 3-4 days to get them replaced.

    In no way am I advertising for proxyblaze but just giving you my experience with different proxy providers. Hope you find something that works for you!
     
  5. innosoft

    innosoft Jr. VIP Jr. VIP Premium Member

    Joined:
    Nov 25, 2008
    Messages:
    1,632
    Likes Received:
    639
    Occupation:
    Software Developer, SEO
    Location:
    Office
    Home Page:
    wont google block ip immediately for scraping?
     
  6. Cobra0702

    Cobra0702 Newbie

    Joined:
    Feb 2, 2012
    Messages:
    4
    Likes Received:
    0
    What does using a proxy do?
     
  7. Tenshisendo

    Tenshisendo Registered Member

    Joined:
    Nov 20, 2010
    Messages:
    64
    Likes Received:
    24
    You are running way to many threads I have 50 Private Proxies scraping with 20 threads for google only and am scraping roughly a million urls a day. I think.. I don't check everyday it usually runs for a week then I load up new footprints and keywords.

    If for some reason you do block your ip in google it will come back in a day or so.

    To stay under the radar I usually run 1/3 threads-proxy ratio.
     
  8. innosoft

    innosoft Jr. VIP Jr. VIP Premium Member

    Joined:
    Nov 25, 2008
    Messages:
    1,632
    Likes Received:
    639
    Occupation:
    Software Developer, SEO
    Location:
    Office
    Home Page:
    i use proxies from thebigproxylist.com.... well i will try again now with another provider. i use private proxies from buyproxies.org.
     
  9. rody00

    rody00 Regular Member

    Joined:
    Feb 25, 2010
    Messages:
    354
    Likes Received:
    80
    Location:
    The Machine City
    check out proxy multiply in the bst section, it works well for me
     
  10. W9go

    W9go Jr. VIP Jr. VIP Premium Member

    Joined:
    May 16, 2011
    Messages:
    3,361
    Likes Received:
    630
    Gender:
    Male
    Occupation:
    chasing girls
    Location:
    chasing girls
    you have to adjust the connections to the proxis. 50% is good.

    so 10 proxis .... 5 connections
     
  11. W9go

    W9go Jr. VIP Jr. VIP Premium Member

    Joined:
    May 16, 2011
    Messages:
    3,361
    Likes Received:
    630
    Gender:
    Male
    Occupation:
    chasing girls
    Location:
    chasing girls
    i use privat proxis from fiverr ... you get 4 or 5 for a month and they work good.

    the scraping and open proxis are crap. way to slow.