URL harvester requied

Discussion in 'Black Hat SEO Tools' started by iglow, Mar 18, 2009.

  1. iglow

    iglow Elite Member

    Joined:
    Feb 20, 2009
    Messages:
    2,079
    Likes Received:
    861
    Home Page:
    Any good working url harvesters? Seems none of previous works..
    Mainly i wanna put some goolge search site query in, and harvest urls.
     
  2. kouxx

    kouxx Junior Member

    Joined:
    Aug 2, 2008
    Messages:
    160
    Likes Received:
    38
    hey, this is your 100th post :rock:
    there is the bhw url harvester in the jr vip section... ;)
     
    Last edited: Mar 18, 2009
  3. skweekykleen

    skweekykleen Newbie

    Joined:
    Jul 8, 2008
    Messages:
    46
    Likes Received:
    68
    not sure if it fits your needs for the exact task you've got at hand, but one little tool that I like is called "Link Gopher" -- it's a firefox plugin.

    PHP:
    https://addons.mozilla.org/en-US/firefox/search?q=link+gopher&cat=all
    It puts a little button at the bottom right-hand side of your browser window, when you click it, it scrapes all of the links from the page you are on, then opens a new tab with them all organized, de-duped, etc.

    When I am just trying to grab a few hundred links for something, I usually just set Google to return 100 results per page, then use this tool to scrape 3-4 pages worth and I'm off...

    Hope it helps...
     
    • Thanks Thanks x 4
  4. iglow

    iglow Elite Member

    Joined:
    Feb 20, 2009
    Messages:
    2,079
    Likes Received:
    861
    Home Page:
    i do not see junior section even thought i have junior next to my nick. where should i find it or who to msg? :)
     
  5. forgot

    forgot Senior Member

    Joined:
    May 3, 2008
    Messages:
    936
    Likes Received:
    707
    Location:
    BlackhatWorld
    How did you come to know about it?

    You are not Jr VIP...

    I guess it is in Jr VIP Section.

    You need to be Jr VIP to see the section.

    Quote:

    Jr. VIP Membership

    If you have been a member of the forum for at least 60 days, and have made at least 100 posts, your $97 donation will promote you to a Jr. VIP membership, which allows you to access the hidden Jr. VIP forums and downloads sections.
     
  6. iglow

    iglow Elite Member

    Joined:
    Feb 20, 2009
    Messages:
    2,079
    Likes Received:
    861
    Home Page:
    Ah that is how it works. So the only way to get to top is $$$ :)
     
  7. ravi72194

    ravi72194 Newbie

    Joined:
    Apr 6, 2007
    Messages:
    11
    Likes Received:
    1
    i have made a script to harvest url just search the particular word and it harvest url from google. but this script is not free . if interested then let me know .
    i will show you DEMO.
     
  8. dekadent30

    dekadent30 Power Member

    Joined:
    Nov 10, 2008
    Messages:
    654
    Likes Received:
    174
    try SerpScraper or global squid se parser
     
  9. rap8557

    rap8557 Jr. VIP Jr. VIP

    Joined:
    Sep 15, 2008
    Messages:
    1,543
    Likes Received:
    520
  10. solobeton

    solobeton Junior Member

    Joined:
    Feb 24, 2008
    Messages:
    105
    Likes Received:
    85
    According to me this is the best scraper i ever use.
    I'm using the demo version as well but i can still get 1000's and 1000's of urls.

    It is in russian, i don't know how to buy the full version.