Extracting URL's

BuzzKill

BuzzKill

Regular Member
Joined
Aug 30, 2007
Messages
431
Reaction score
222
What would be the best program for extracting URL's? Specifically from SE's. It would be great if you could control how deep it went so that it didnt spider off into oblivion. Give it a search url and have it grab all the URLs that are displayed. Any ideas?
 
Advertise on BHW
Well, a simple PHP/CURL script would do the job, just work out the regular expression or google it. My brain is incapable of memorizing regex; I have to go through the entire regex tutorial everytime I need it.

But yeah, something like that should do it. It'll just take a little more research and work on your part. Hey, it's good for you! ;)
 
here yah go just made a simple proggy in VB that will extract all the urls from a webpage ive included the source code just incase you want to add anything..
hope this is what you was looking for

gethere.org/ExUrls.rar

would post an image but the crazy rules only allow me 2 post image after 15 posts.. oh well
 
exurls.jpg


http://gethere.org/ExUrls.rar
 
theprovider777 said:
Well, a simple PHP/CURL script would do the job, just work out the regular expression or google it. My brain is incapable of memorizing regex; I have to go through the entire regex tutorial everytime I need it.

But yeah, something like that should do it. It'll just take a little more research and work on your part. Hey, it's good for you! ;)
Click to expand...

This is true. I must say, the people in this forum are a find bunch of people. Lots of patience and lots of brains, I have only found one other forum with the same type of people, Im fairly sure its bad etiquette to post other boards, but the name has an 8 in it. Smart, helpful people as well.
 
My two cents :

This is a free utility which extract URLs from SEs very fast.

www (dot) focalmedia (dot)net/urlextractor

Regards
 
Advertise on BHW
You must log in or register to reply here.
Sign up now!

Main Menu

Home Main Forum List Black Hat SEO White Hat SEO BHW Newbie Guide Blogging Black Hat Tools Social Media Downloads

Marketplace

Account Selling Content / Copywriting EBooks / Methods Hosting Misc Proxies For Sale SEO - Link building SEO - Packages Social Media Social Media - Panels Web Design More

Making Money

Affiliate Programs Hire a Freelancer IM Journeys Making Money Pay Per Click Site Flipping Want to Buy

BlackHat World

Dispute Resolution Forum Suggestions & Feedback Introductions Lounge
Back
Top