1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

URL harvester requied

Discussion in 'Black Hat SEO Tools' started by iglow, Mar 18, 2009.

  1. iglow

    iglow Elite Member

    Joined:
    Feb 20, 2009
    Messages:
    2,081
    Likes Received:
    856
    Home Page:
    Any good working url harvesters? Seems none of previous works..
    Mainly i wanna put some goolge search site query in, and harvest urls.
     
  2. kouxx

    kouxx Junior Member

    Joined:
    Aug 2, 2008
    Messages:
    160
    Likes Received:
    38
    hey, this is your 100th post :rock:
    there is the bhw url harvester in the jr vip section... ;)
     
    Last edited: Mar 18, 2009
  3. skweekykleen

    skweekykleen Newbie

    Joined:
    Jul 8, 2008
    Messages:
    45
    Likes Received:
    68
    not sure if it fits your needs for the exact task you've got at hand, but one little tool that I like is called "Link Gopher" -- it's a firefox plugin.

    PHP:
    https://addons.mozilla.org/en-US/firefox/search?q=link+gopher&cat=all
    It puts a little button at the bottom right-hand side of your browser window, when you click it, it scrapes all of the links from the page you are on, then opens a new tab with them all organized, de-duped, etc.

    When I am just trying to grab a few hundred links for something, I usually just set Google to return 100 results per page, then use this tool to scrape 3-4 pages worth and I'm off...

    Hope it helps...
     
    • Thanks Thanks x 4
  4. iglow

    iglow Elite Member

    Joined:
    Feb 20, 2009
    Messages:
    2,081
    Likes Received:
    856
    Home Page:
    i do not see junior section even thought i have junior next to my nick. where should i find it or who to msg? :)
     
  5. forgot

    forgot Jr. VIP Jr. VIP Premium Member

    Joined:
    May 3, 2008
    Messages:
    936
    Likes Received:
    706
    Location:
    BlackhatWorld
    How did you come to know about it?

    You are not Jr VIP...

    I guess it is in Jr VIP Section.

    You need to be Jr VIP to see the section.

    Quote:

    Jr. VIP Membership

    If you have been a member of the forum for at least 60 days, and have made at least 100 posts, your $97 donation will promote you to a Jr. VIP membership, which allows you to access the hidden Jr. VIP forums and downloads sections.
     
  6. iglow

    iglow Elite Member

    Joined:
    Feb 20, 2009
    Messages:
    2,081
    Likes Received:
    856
    Home Page:
    Ah that is how it works. So the only way to get to top is $$$ :)
     
  7. ravi72194

    ravi72194 Newbie

    Joined:
    Apr 6, 2007
    Messages:
    11
    Likes Received:
    1
    i have made a script to harvest url just search the particular word and it harvest url from google. but this script is not free . if interested then let me know .
    i will show you DEMO.
     
  8. dekadent30

    dekadent30 Power Member

    Joined:
    Nov 10, 2008
    Messages:
    516
    Likes Received:
    145
    try SerpScraper or global squid se parser
     
  9. rap8557

    rap8557 Jr. VIP Jr. VIP Premium Member

    Joined:
    Sep 15, 2008
    Messages:
    1,083
    Likes Received:
    436
  10. solobeton

    solobeton Junior Member

    Joined:
    Feb 24, 2008
    Messages:
    106
    Likes Received:
    85
    According to me this is the best scraper i ever use.
    I'm using the demo version as well but i can still get 1000's and 1000's of urls.

    It is in russian, i don't know how to buy the full version.