1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Is Google blocking Scrapebox?

Discussion in 'Black Hat SEO' started by reggy, Dec 11, 2011.

  1. reggy

    reggy Registered Member

    Joined:
    Mar 16, 2010
    Messages:
    91
    Likes Received:
    11
    Hello,
    I have noticed recently that i can no longer scrape as much URLs as before from Google even though i am using private proxies.

    I currently use 70 private proxies from both yourprivateproxy and squidproxies!

    I also run cc cleaner before each scraping run.

    On a run where Bing and Yahoo might give me millions of URLs, Google would only bring back a few thousand, usually no more than 5 figures.

    Does anyone have this same problem?

    Is there something am doing wrong?

    I use the exact SB settings that Loopline recommends

    Thanks
     
  2. ch8878

    ch8878 Elite Member

    Joined:
    Mar 21, 2009
    Messages:
    2,242
    Likes Received:
    428
    Gender:
    Male
    Occupation:
    Gamer
    Location:
    Youtube
    Home Page:
    I think bookmarks are the only thing worth a crap now.
     
  3. reggy

    reggy Registered Member

    Joined:
    Mar 16, 2010
    Messages:
    91
    Likes Received:
    11
    Bookmarks dont carry much weight!
     
  4. acotut

    acotut Elite Member

    Joined:
    Dec 1, 2010
    Messages:
    2,294
    Likes Received:
    1,040
    Gender:
    Male
    Home Page:
    I don't know everything is fucked up this days,google,youtube,yahoo.Looking like they want to get rid of any SEO techiques,beside onpage SEO
     
  5. bigvito21

    bigvito21 BANNED BANNED

    Joined:
    Jun 17, 2011
    Messages:
    272
    Likes Received:
    8
    I told y'all before blackhat is just temporary.
     
  6. RebelMaster

    RebelMaster Junior Member

    Joined:
    Jan 31, 2008
    Messages:
    172
    Likes Received:
    97
    Wouldn't surprise me a bit these days. It's all about control and they keep trying to put up more and more roadblocks. Some work some don't. The gov't and SEs seem hellbent on getting rid of most affiliates especially in U.S.

    RM
     
  7. reggy

    reggy Registered Member

    Joined:
    Mar 16, 2010
    Messages:
    91
    Likes Received:
    11
    So is anyone else having problems scraping Google with Scrapebox?
     
  8. acotut

    acotut Elite Member

    Joined:
    Dec 1, 2010
    Messages:
    2,294
    Likes Received:
    1,040
    Gender:
    Male
    Home Page:
    You're wrong,there will always be ways to trick the system,nothing is perfect.
     
  9. acotut

    acotut Elite Member

    Joined:
    Dec 1, 2010
    Messages:
    2,294
    Likes Received:
    1,040
    Gender:
    Male
    Home Page:
    The government haz nothing to do with this.Google is just a search engine that wants only QUALLITY links to be posted on his first pages,else the adwords advertisers won't put as much money as they did.
    This is a business,and will remain as one.There are Thousands of statistics that they care about...
    If the affiliates would bring as much money as everyone else,you think they will try to stop them?
     
  10. scrapefox

    scrapefox Power Member

    Joined:
    Dec 3, 2011
    Messages:
    692
    Likes Received:
    277
    Can't say I have run in to this problem. Scraped around 4 million a few days ago from just Google. Maybe you're running too many threads and getting your proxies temp banned fast?
     
  11. ch8878

    ch8878 Elite Member

    Joined:
    Mar 21, 2009
    Messages:
    2,242
    Likes Received:
    428
    Gender:
    Male
    Occupation:
    Gamer
    Location:
    Youtube
    Home Page:
    What bookmarks do you use ? The ones I use are PR 9 down.
     
  12. moneyfreedom

    moneyfreedom Regular Member

    Joined:
    Jul 1, 2011
    Messages:
    274
    Likes Received:
    374
    Occupation:
    Internet Marketer
    Home Page:
    I've been having the same issue. A week ago I was able to get hundreds of thousands of scraped sites from google but today i'm only able to get a couple thousand and that is with using the same keywords list. If anyone knows a way around this i'd love to hear it. I'll be using bing/yahoo/aol for now :/
     
  13. reggy

    reggy Registered Member

    Joined:
    Mar 16, 2010
    Messages:
    91
    Likes Received:
    11
    @scrapefox - i am running 20threads just like Loopline recommended!

    How many threads do u run and what is ur random delay set at?
     
  14. alaltaierii

    alaltaierii Supreme Member

    Joined:
    Jun 11, 2010
    Messages:
    1,408
    Likes Received:
    349
    I had the same problem yesterday and two days ago.
    But few minutes ago I scraped about 300 fresh public proxies and start to harvest. It seems google harvester is back to normal. My magic number of connections for google scrape is: 35. :D
     
  15. reggy

    reggy Registered Member

    Joined:
    Mar 16, 2010
    Messages:
    91
    Likes Received:
    11
    @alaltaierii - how many urls r u able to scrape from Google?
     
  16. jerdude

    jerdude Jr. VIP Jr. VIP Premium Member

    Joined:
    Feb 27, 2009
    Messages:
    119
    Likes Received:
    14
    Home Page:
    It is getting slower but I think I'm starting to find a solution. Nothing solid yet.
     
  17. acotut

    acotut Elite Member

    Joined:
    Dec 1, 2010
    Messages:
    2,294
    Likes Received:
    1,040
    Gender:
    Male
    Home Page:
    This is why I love bhw!
     
  18. thinkdevoid

    thinkdevoid Regular Member

    Joined:
    Aug 30, 2011
    Messages:
    446
    Likes Received:
    131
    Location:
    192.168.1.1
    I think it really depends on the type of connection + computer. I harvest at 50 but I have a fast connection.

    I've also just done a nice-sized run tonight. 200 public proxies ( I have a rather big list so I can grab these relatively easy). 500k+ blogs. etc etc.
     
  19. genesis311

    genesis311 Junior Member

    Joined:
    Jun 15, 2011
    Messages:
    179
    Likes Received:
    97
    Lol at you and your warrior forum misinformation
     
  20. Autumn

    Autumn Elite Member

    Joined:
    Nov 18, 2010
    Messages:
    2,197
    Likes Received:
    3,041
    Occupation:
    I figure out ways to make money online and then au
    Location:
    Spamville
    Try scraping meta search engines that pull their results from Google (and other SEs).