1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Question about Scrapebox harvester

Discussion in 'Black Hat SEO' started by shadowfax, Mar 14, 2011.

  1. shadowfax

    shadowfax Power Member

    Joined:
    Mar 9, 2009
    Messages:
    513
    Likes Received:
    695
    Occupation:
    IM, Marketing, Programming
    Location:
    Where there is money baby
    Hey guys,

    Got a question about SB harvester. Let's say I am trying to scrape results for a custom footprint from Google

    keyword "powered by blogengine" "add comment"

    for a specific keyword. Now when I search this in Google for the keyword I get more than 350,000 results. But when I scrape with SB I get only 2500 results after deleting duplicates. Then I scrape again and I get 1000 more results (after deleting duplicates) . In third run I get 1500 more and so on..

    So my question is - is it normal to get so less results while harvesting? And How many times should I harvest using the same set of footprints to get good number of results, is there any best practice available?

    FYI I am using the proxies available through BHW and SB .

    Best Regards,
     
  2. cyberzilla

    cyberzilla Elite Member Premium Member

    Joined:
    Nov 15, 2009
    Messages:
    2,204
    Likes Received:
    3,363
    Location:
    zeta reticuli
    Some times G0ogle won't show the correct search result counts. Just add &start=990 at the end of the URL after searching the keyword in google. This will take you to the last page of the search result for the entered keywords where you can see the real search result count.

    Did you compare all these lists? May be they are same set of URLs...
     
  3. shadowfax

    shadowfax Power Member

    Joined:
    Mar 9, 2009
    Messages:
    513
    Likes Received:
    695
    Occupation:
    IM, Marketing, Programming
    Location:
    Where there is money baby
    Thanks I'll check this..

    Yeah man, thats what I meant in my original post.. I am getting 1500 NEW results after deleting duplicates. Don't know why this is happening...

    Regards,
     
  4. Gibbzee

    Gibbzee Regular Member

    Joined:
    Jun 17, 2009
    Messages:
    399
    Likes Received:
    142
    If you are using proxies, which i presume you are, it could depend on the location of them.
     
  5. shudogg

    shudogg Regular Member

    Joined:
    Sep 23, 2008
    Messages:
    412
    Likes Received:
    153
    Occupation:
    Internet Marketing
    Location:
    Indiana
    Home Page:
    You need to be using a large list of keywords. SB will only pull so many results per keyword. If you have only a few keywords, you won't get many urls harvested. Try using a large keyword list.. also try doing a-z and 0-9 like...

    a
    b
    c
    d
    0
    1
    2
    3

    Obviously I didn't go all the way to z or 9 lol, but hopefully you get the point.