1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Scrape all the google search result for a keyword

Discussion in 'Black Hat SEO' started by anguschkong, Oct 30, 2014.

  1. anguschkong

    anguschkong Junior Member

    Joined:
    Jun 6, 2013
    Messages:
    109
    Likes Received:
    13
    Hi, is there a tool to Scrape all the google search result for a keyword?

    I have scrape box. but i don't know how to do this. urgent..
    thanks.
     
  2. SerpEvil

    SerpEvil Supreme Member

    Joined:
    Jan 1, 2012
    Messages:
    1,495
    Likes Received:
    446
    Gender:
    Male
    Occupation:
    WebMaster
    Location:
    Top 3 On Google
    yes,you can do it with scrapebox or even better with Gscraper
     
  3. Nightly

    Nightly Regular Member

    Joined:
    Oct 18, 2013
    Messages:
    292
    Likes Received:
    79
    I have been a long time Scrapebox user. What does Gscraper have that Scrapebox doesn't? More features, faster?

    Not defending a product (Scrapebox), just actually Interested.
     
  4. loopline

    loopline Jr. VIP Jr. VIP

    Joined:
    Jan 25, 2009
    Messages:
    3,375
    Likes Received:
    1,799
    Gender:
    Male
    Home Page:
    It is currently faster if you have enough proxies and you can buy proxies from them for use in the tool. Scrapebox 2.0 (although not yet released) is faster then Gscraper and you can get prefiltered proxies from Scrapebox for free in 2.0. So right now it has 2 advantages that I can see, shortly it will have none. My 2 cents. perhaps someone else see something else.

    You have Scrapebox so you just load in the keyword in the keyword box and click start harvesting and choose your engine and follow thru and you will get the results. Make sure you have the results box set to 1000, its in the lower left hand quadrant of the main Scrapebox window.

    If there are more then 1000 results then you need to merge in keywords with the original keyword like

    keyword a
    keyword b
    keyword c


    So you force the engines to return different result sets from their database and thus you get a broader scope. Then just remove duplciate urls and your set.
     
  5. davids355

    davids355 Jr. VIP Jr. VIP Premium Member

    Joined:
    Apr 25, 2011
    Messages:
    8,789
    Likes Received:
    6,326
    Home Page:
    Easy to do with scrapebox, pretty much put in the keywords and hit scrape.
    then tidy up the url list afterwards.
    havent really used gacraper, but I've also heard it's faster and can handle more data/bigger lists.
     
  6. erminc

    erminc Junior Member

    Joined:
    Mar 20, 2014
    Messages:
    142
    Likes Received:
    29
    Biggest + is that you can scrape easy with gscraper only using public proxies. I get 10k p/m with just public proxies. However with scrapebox you need everytime to scan the proxies which is really time consuming.

    For now Gscraper is the best tool for me for scraping withouth private proxies.

    But I do look out to the new scrapebox 2.0 version.

    Posted via Topify using iPhone/iPad
     
  7. The SEO

    The SEO Jr. VIP Jr. VIP Premium Member

    Joined:
    Dec 14, 2011
    Messages:
    3,975
    Likes Received:
    3,115
    Occupation:
    SEO/SMM
    Location:
    BHW
    To me, just ScrapeBox is the tool which has ability to scrape every URL relevant to desiring keyword.
     
  8. anguschkong

    anguschkong Junior Member

    Joined:
    Jun 6, 2013
    Messages:
    109
    Likes Received:
    13
    So I just need to remove the footprint and type in the keyword then scrape?
     
  9. berth

    berth Regular Member

    Joined:
    Feb 10, 2014
    Messages:
    210
    Likes Received:
    49
    Hrefer is much faster than Gscraper. Avoid scrapebox.
     
  10. BHopkins

    BHopkins Moderator Staff Member Moderator Jr. VIP

    Joined:
    Dec 31, 2010
    Messages:
    2,311
    Likes Received:
    1,387
    Gender:
    Male
    Occupation:
    ORM and SEO company owner
    Location:
    California
    Home Page:
    If you already own scrapebox, use that. It doesn't sound like you're going to do a whole lot of scraping. GScraper is MUCH faster, but that's only when you're talking millions of results.
     
  11. BHopkins

    BHopkins Moderator Staff Member Moderator Jr. VIP

    Joined:
    Dec 31, 2010
    Messages:
    2,311
    Likes Received:
    1,387
    Gender:
    Male
    Occupation:
    ORM and SEO company owner
    Location:
    California
    Home Page:
    And you'll also need proxies. If you don't have proxies, it might be better for you to pay someone to scrape whatever you need. I'm sure there are people in Hire a Freelancer who would do it for you.