1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

SERP Scraper Needed (I already have Scrapebox)

Discussion in 'Black Hat SEO Tools' started by Stu784, Oct 8, 2010.

  1. Stu784

    Stu784 Regular Member

    Joined:
    Nov 2, 2009
    Messages:
    426
    Likes Received:
    106
    Can anyone please advise on or point me in the direction of a free tool which will scrape URLs from a search engine result for any given keyword.

    So you'd type in the target keyword and it would scrape, say for example, the top 30 URLs or 3 pages of results. The more the merrier :)

    I have Scrapebox however can't workout a footprint that will do this and when I compare my SB results to Google they are not the same URL's for the same keyword search.
     
  2. outsidethesquare

    outsidethesquare Regular Member

    Joined:
    Sep 9, 2009
    Messages:
    269
    Likes Received:
    159
    Just set results to 30 and select only google for your country as your search engine?
     
  3. lucius

    lucius Power Member

    Joined:
    Jul 29, 2009
    Messages:
    546
    Likes Received:
    158
    I am looking for this too
     
  4. Stu784

    Stu784 Regular Member

    Joined:
    Nov 2, 2009
    Messages:
    426
    Likes Received:
    106

    Tried that and the results don't match what I get in Google
     
  5. Stu784

    Stu784 Regular Member

    Joined:
    Nov 2, 2009
    Messages:
    426
    Likes Received:
    106
    This does the job and brings back about 1000 results in order of ranking:

    Code:
    http://www.blackhatworld.com/blackhat-seo/blackhat-lounge/205193-free-serp-link-scraper.html

    Text comes back as on long paragraph with a comma between each URL

    To change to a list go to MS Word, edit, then replace and replace the comma "," with "paragraph mark" (this is in the special drop down list under more) then copy and paste to notepad and save file.

    I just did a like for like comparison and it was about 95% the same as the results were probably pulled from different Google servers at the time of the search. By this I mean some of the top 10 were in a slightly different order.

    HTH
     
  6. loopline

    loopline Jr. VIP Jr. VIP

    Joined:
    Jan 25, 2009
    Messages:
    3,380
    Likes Received:
    1,801
    Gender:
    Male
    Home Page:
    Your missing the boat. Scrapebox pulls EXACTLY from google what you can manually. If you are getting different results is because your either feeding scrapebox a different footprint then you are google manually, or you are using proxies and its pulling from a different data center.

    Different google data centers will return different results. (or they can anyway).

    Anyway, the point there is rather then seeking out another tool, and going thru the work to manipulate its output to the way you want it, it would be better to just learn how to more effectively use scrapebox.

    Great reading would be "the dip" by seth godin
     
  7. keinehabe

    keinehabe Supreme Member

    Joined:
    Nov 4, 2008
    Messages:
    1,207
    Likes Received:
    472
    Gender:
    Male
    Occupation:
    -= CEO =-
    Location:
    Heaven
    Home Page:
    anyone if have all query for google / yahoo / msn .... or can grab them from somewhere ... and if so gentle to drop an pm maybe ... for example what footprint it's needed to find wp blogs , movatiple ... forums ... :) and so on actually nice places where links for a site can be left ...
     
  8. Stu784

    Stu784 Regular Member

    Joined:
    Nov 2, 2009
    Messages:
    426
    Likes Received:
    106
    Understand the different servers however what I get in Scrapebox is a country mile away from what the top 10 is in Google.

    It wasn't one site ranking 3rd in Google and then 5th in Scrapebox,s Google scrape
    Posted via Mobile Device
     
  9. promosirupiah

    promosirupiah Junior Member

    Joined:
    Jul 11, 2010
    Messages:
    149
    Likes Received:
    33
    I use imacros to do repetition: save page and klik next.
    Then I use data extractor to open folder that contain several saved pages, extract url, export to excel, do some manual filter.

    I can do it not just for google serp, but for facebook profile scrape, email scrape, anything you want, because data extractor can filter anything.