1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Looking for a Google results scraper, but it's not what you think...

Discussion in 'BlackHat Lounge' started by referraldude, Nov 29, 2012.

  1. referraldude

    referraldude Registered Member

    Joined:
    Jan 19, 2010
    Messages:
    87
    Likes Received:
    50
    Location:
    The Devil's Den
    Hey all,

    I'm looking for a Google scraper that doesn't scrape SERPs, or PPC, or Google Places.
    I'm looking for a Google scraper that DOES scrape Google's redirect out of their SERPs.

    Example:
    If you type in a search for a term (let's use Best Buy for an example), the SERPs come up as they always do, right?
    What I'm looking for is a program that grabs the Google redirect link before it goes to the main site. You'll see it in your URL bar for a split second if you click any SERP result, try it for yourself.

    Anybody know of anything that would grab this? I know it's probably an unusual request, but it's for a data study, and I'll be more than happy to post results here afterwards.

    Thanks
     
  2. artizhay

    artizhay BANNED BANNED

    Joined:
    Nov 21, 2010
    Messages:
    1,867
    Likes Received:
    1,335
    Well yeah, it's pretty simple to do. How many pages do you need to scrape?
     
  3. referraldude

    referraldude Registered Member

    Joined:
    Jan 19, 2010
    Messages:
    87
    Likes Received:
    50
    Location:
    The Devil's Den
    I'm looking to scrape entire sites, and probably just first pages in SERPs for the test.
     
  4. BHopkins

    BHopkins Moderator Staff Member Moderator Jr. VIP

    Joined:
    Dec 31, 2010
    Messages:
    2,316
    Likes Received:
    1,389
    Gender:
    Male
    Occupation:
    ORM and SEO company owner
    Location:
    California
    Home Page:
    Have you looked at the source of a good search result page? It's all encoded, doesn't look easy on my end.