1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Tool to extractURL's from G Search Results

Discussion in 'Black Hat SEO Tools' started by supahoopsa, Sep 4, 2009.

  1. supahoopsa

    supahoopsa Junior Member

    Joined:
    Apr 20, 2007
    Messages:
    118
    Likes Received:
    5
    Have been searching around for a while to find a free (or cracked) piece of software that will extract URL's from a G search.

    So if I search for "great red widgets" it will do a search in Google for that KW phrase and then extract the URL's from the first x number of listings to a text or csv file.

    I have seen various tools that do the first 100 but need a lot more than that.

    Thanks in advance
    David
     
  2. undeterminederror

    undeterminederror BANNED BANNED

    Joined:
    Mar 31, 2008
    Messages:
    630
    Likes Received:
    457
    First: you set google show 100 results/page

    Then you have to install 2 mozilla plugins:
    -autopager mozila plugin
    -snap links plus mozila plugin

    with the first plugin you will see 1000 google results.
    with the second plugin you will select the results with the mouse right button then clic ctrl -> copy ; open a txt file then paste.

    ta - daaa: 1000 links in less than 1 min ;)
     
    • Thanks Thanks x 5
  3. supahoopsa

    supahoopsa Junior Member

    Joined:
    Apr 20, 2007
    Messages:
    118
    Likes Received:
    5
    Thanks, great suggestion

    Any others ?
     
  4. blackhaty

    blackhaty Junior Member

    Joined:
    Feb 24, 2008
    Messages:
    125
    Likes Received:
    50
    try scrape genius.
     
    • Thanks Thanks x 1
  5. supahoopsa

    supahoopsa Junior Member

    Joined:
    Apr 20, 2007
    Messages:
    118
    Likes Received:
    5
    Thanks, that s/w looks exactly what I was after.

    Downloaded okay but email registration appears to be broken :(
     
  6. mailcold

    mailcold Newbie

    Joined:
    Jun 6, 2009
    Messages:
    17
    Likes Received:
    4
    The URL for snap links plus mozila plugin is

    snaplinks.mozdev.org
     
    Last edited: Sep 13, 2009
  7. orangeblossoms

    orangeblossoms Regular Member

    Joined:
    Jun 16, 2009
    Messages:
    228
    Likes Received:
    247
    Damn this is awesome and so simple. With snap links though, when I paste it into notepad, there is no line break between each url. How do I get the urls on each separate line?

    EDIT:
    Okay I figured it out that it's "\n" for line break, but not all urls have the same ending. Any easy way to move all links onto their own line?
     
    Last edited: Sep 13, 2009
  8. JohnKarr

    JohnKarr Junior Member

    Joined:
    Aug 12, 2009
    Messages:
    128
    Likes Received:
    22
    Occupation:
    Internet Marketer/Actor
    Location:
    Oregon
    just use lazerURL
     
  9. Debian

    Debian Jr. VIP Jr. VIP Premium Member

    Joined:
    Feb 17, 2009
    Messages:
    714
    Likes Received:
    282
    Occupation:
    Residential Proxies & VPN's
    Home Page:
    Link Whore for sure. Best by far!
     
  10. markdigerati

    markdigerati Junior Member

    Joined:
    Nov 21, 2007
    Messages:
    113
    Likes Received:
    28
  11. 44blackhatters

    44blackhatters Registered Member

    Joined:
    Jan 21, 2008
    Messages:
    52
    Likes Received:
    3
    The firefox plugins suggested are great...these will be very helpful. Thanks.
     
  12. undeterminederror

    undeterminederror BANNED BANNED

    Joined:
    Mar 31, 2008
    Messages:
    630
    Likes Received:
    457
    instead adding line break after the link add it in front the link, in front the http ;)





    other twists:

    with the search->replace function you can clean scraped lists like seobook most searched terms or google images links, actually, scrapping google images is pretty damn good for seo and traffic(for the ones who know to use them).
    you can use search-replace from office word, wordpad or notepad++
     
  13. orangeblossoms

    orangeblossoms Regular Member

    Joined:
    Jun 16, 2009
    Messages:
    228
    Likes Received:
    247
    Lol I feel stupid now. This calls for an appropriate emoticon. :smashfrea
    Thanks for the help and twists! I like your scraping method, it's nice and fast.