1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Anyone else having Problems Scraping from Google using Scrapebox?

Discussion in 'Black Hat SEO' started by w-nada, Feb 20, 2012.

  1. w-nada

    w-nada BANNED BANNED

    Joined:
    Jan 13, 2012
    Messages:
    77
    Likes Received:
    13
    Hello,

    This has been frustrating me the last few days. Scrapebox only harvests URL's from Yahoo but when it comes to google I get zero results, is this happening to everyone or is it just me? and if it's just me, what do I do to fix that??


    Thanks in advance.
     
  2. Ramsweb

    Ramsweb Senior Member

    Joined:
    Mar 31, 2010
    Messages:
    1,121
    Likes Received:
    658
    Occupation:
    Internet Marketer - Self Employed
    Location:
    In front of my PC
    I did a run yesterday and it seemed to be fine. Are you using proxies? Are they good? Are you using some advanced search operators like inurl:xxx in all your searches. When you use advanced search operators, proxies burn out pretty quickly.
     
    • Thanks Thanks x 1
  3. w-nada

    w-nada BANNED BANNED

    Joined:
    Jan 13, 2012
    Messages:
    77
    Likes Received:
    13
    I am using Squid Proxies and no I am not using anything advanced :( Can it be connection problems?
     
  4. scrapefox

    scrapefox Power Member

    Joined:
    Dec 3, 2011
    Messages:
    692
    Likes Received:
    277
    Few obvious questions:

    You have the Google box checked right?

    When you're checking your proxies, you don't have ignore Google checked, so you know they're not banned from Google?
     
  5. Ramsweb

    Ramsweb Senior Member

    Joined:
    Mar 31, 2010
    Messages:
    1,121
    Likes Received:
    658
    Occupation:
    Internet Marketer - Self Employed
    Location:
    In front of my PC
    Just reinstall scrapebox again. It happened to me once before. Try running an update as well.
     
  6. w-nada

    w-nada BANNED BANNED

    Joined:
    Jan 13, 2012
    Messages:
    77
    Likes Received:
    13
    I have them checked and they are not banned from google so not that either.

    Done, will see if anything goes different and post back here.
     
  7. Nosence

    Nosence Senior Member

    Joined:
    Dec 28, 2010
    Messages:
    925
    Likes Received:
    42
    I havent been having any issues, but I use all private or semi private for everything I do

    I gave up on Public proxies a long time ago
     
    • Thanks Thanks x 1
  8. w-nada

    w-nada BANNED BANNED

    Joined:
    Jan 13, 2012
    Messages:
    77
    Likes Received:
    13
    I re-installed it and still not scraping from Google, anyone has suggestions?

    I am contacting customer service.
     
  9. shiningeyes

    shiningeyes BANNED BANNED

    Joined:
    Feb 7, 2011
    Messages:
    415
    Likes Received:
    297
    I am also having problems with it...
    i am getting 1 url instead of 100.
     
  10. sixalarm

    sixalarm Regular Member

    Joined:
    Aug 21, 2011
    Messages:
    244
    Likes Received:
    101
    Location:
    The Enterprise
    I experienced this problem about a week ago. Turns out, it was my proxies. Even though scrapebox was saying they passed google, they just weren't working. On a hunch, I bought some new proxies from a different provider and everything went back to normal. I was using squidproxies but now I am using buyproxies.org. Hope this helps!

    If you wanna test and see if you are having the same problem I was, then harvest some public ones just to test it out. If they work better than your private proxies from squid, then you are having the same problem I was.
     
    • Thanks Thanks x 1
  11. w-nada

    w-nada BANNED BANNED

    Joined:
    Jan 13, 2012
    Messages:
    77
    Likes Received:
    13
    Ok, now this is strange!

    I harvested some free proxies and guess what? scraping works now!


    So is the problem with Squidproxies?? Who else is using Squidproxies and experiencing problems?
     
  12. LakeForest

    LakeForest Supreme Member

    Joined:
    Nov 11, 2009
    Messages:
    1,269
    Likes Received:
    1,802
    Location:
    Location Location
    Squidproxies is the problem...

    I get my own public proxies and scrape (timed scrape/google 24hours) public proxies.

    never ever have I ever had a problem with these proxies ever. ever.

    Don't buy proxies to scrape...come on, use your noggin
     
  13. w-nada

    w-nada BANNED BANNED

    Joined:
    Jan 13, 2012
    Messages:
    77
    Likes Received:
    13
    I contacted Squid Proxies and they fixed the problem in no time! It works right now.

    Can you tell me and the rest of us about what exactly you do to scrape these proxies?
     
  14. LakeForest

    LakeForest Supreme Member

    Joined:
    Nov 11, 2009
    Messages:
    1,269
    Likes Received:
    1,802
    Location:
    Location Location
    For real? Like, really real?

    scrape for the ones that google pass in google. then put those urls in the proxy harvester...and there you have like 300,000 to test. It should be noted that from this list, you'll get like 20,000 uniques, which is hilarious if you think about it: everyone passes and posts pretty much the same lists AND have duplicates within their lists. It's just great.

    Edit: ...Did I get trolled? I feel like I just explained how to change a tire to a mechanic...
     
    Last edited: Feb 20, 2012
  15. sixalarm

    sixalarm Regular Member

    Joined:
    Aug 21, 2011
    Messages:
    244
    Likes Received:
    101
    Location:
    The Enterprise
    Lol I think he meant like how do you scrape for them.

    I just select the 24/hr option from the time and put like ":8080" etc for the keywords and then just test the links that it finds.
     
    • Thanks Thanks x 1
  16. monk13

    monk13 Power Member

    Joined:
    Jul 10, 2009
    Messages:
    547
    Likes Received:
    268
    what strings/footprints do you use to scrape for these proxies
     
  17. w-nada

    w-nada BANNED BANNED

    Joined:
    Jan 13, 2012
    Messages:
    77
    Likes Received:
    13
    Yes, this is what I meant.
    and I am female by the way :)

    P.S: harvesting is down again. SquidProxies are ruining my life.
     
  18. Enklave

    Enklave Senior Member

    Joined:
    Apr 30, 2011
    Messages:
    801
    Likes Received:
    1,083
    Location:
    World of the Internet
    I hev other proxies then the squid and I have the same problem...But I didn' use SB last 24 hours, so they can't be banned.
     
  19. dichotomy

    dichotomy Regular Member

    Joined:
    Apr 17, 2011
    Messages:
    274
    Likes Received:
    52
    Yup - I noticed squidproxies die in scrapebox fast, best to just use some public ones
     
  20. LakeForest

    LakeForest Supreme Member

    Joined:
    Nov 11, 2009
    Messages:
    1,269
    Likes Received:
    1,802
    Location:
    Location Location
    Go to the free proxies section on this very forum, get a bunch, put them all in scrapebox, test them. export the good ones to your list. scrape.

    If you use at least 100 google/ip passed, you will not have any trouble at all scraping.

    It's hilarious looking at how many users are in browsing each forum. Proxies has like 1000 while the others have ten-200 with the odd 400-600. Hilarious. Leeecheeeerrrrssss :)

    The reason you scrape with public proxies is because of the high incidence of the proxies getting blocked...AND eventually unblocked. You post with private proxies so you won't get flagged for using an IP that has been marked as a spammer.

    I get 500+ fresh IPs a day just to scrape. I'll only buy 20-30 a month to post.

    Edit: For an idea, this morning I was playing around with new sources, I got 300 scrapebox working proxies(5 hours ago). Put that same list in now, got 20 working. Yeah, they go FAST.
     
    Last edited: Feb 23, 2012