Website Link Extractor ???
- Thread starter WTennisPL
- Start date
haridada
Senior Member
- Oct 9, 2008
- 1,000
- 385
one question i want to know is, i have a site full of .html files and .php files too. Does any of the above tool just extract the .html files only?
Just want to know so i could download the one which does what i need?
All of them has exclusion extensions there , so if you are trying to avoid to extract .php files , you can try to add it to other extensions like .jpg , .swf and the others , I have never try it but I think it should avoid visiting it (all of them has this option I think , Visual Web Spider is best because you can also setup H1 , H2 , H3 , <title> , <body> , <p> , <br> , <html> almost all tags , so it is much more powerful than web data extractor or win web crawler , I like win web crawler because it is quick and for link extraction is the best , I wanted to upload it here too , but when I wanted to test it for viruses , I have found 13 -one question i want to know is, i have a site full of .html files and .php files too. Does any of the above tool just extract the .html files only?
Just want to know so i could download the one which does what i need?
, so I didn't post it here , I am using it for 2 years , never had a problem but the program is not clean .yes , it can , all of them support external links extraction, you can also setup following those external links to another sites , so it can grab the links infinitely
Derek Foreal
Regular Member
- Apr 10, 2010
- 202
- 788
Well you could always use a simple pc of java script code that you just simply create a bookmark in firefox and Name the bookmark something descriptive such as "Scrape All Links" then for the location copy & paste the below pc of java script.
Every-time you hit that bookmark it'll scrape all links on the page you have open and it'll open a new page with all the links it scraped so you can easily save it, copy & paste it somewhere, etc.
I used to use this alot and it's quite handy even though I haven't used it in awhile 8)
Every-time you hit that bookmark it'll scrape all links on the page you have open and it'll open a new page with all the links it scraped so you can easily save it, copy & paste it somewhere, etc.
I used to use this alot and it's quite handy even though I haven't used it in awhile 8)
Code:
javascript:loc=location.href;x=document.getElementsByTagName(%22A%22);y=window.open();y.document.write(%22<html><head><title>Ripped%20Links<title></head><body><h3>Links%20from%20%22+loc+%22</h3>%22);for(n=0;n<x.length;++n){if(x[n].href!=%22%22)y.document.write(%22<p>%22+x[n].href+%22%20</p>%22);}y.document.write(%22</body></html>%22);y.document.close();void%200;I am not an owner of the soft - Visual web spider was best so I 've purchased it , Web data extractor I have uploaded here one month ago (search for it ), it works , win web crawler I can upload here too - works really very smoothly and quickly , but as I said , I use it 2 years but when I was willing to upload it here too, I made a virustotal which reported it is 13/43 virus positive .
I never got any error with visual web spider ... strange u did.
SuperLinks
Elite Member
- Jul 14, 2008
- 2,903
- 852
Scrapebox can do it.
Just Scrape all of the sites URLs, or use its XML/Sitemap crawler functionality.
Then load those into the link extractor plugin, opt in for either internal or external, or both and let it loose.
You'll get the links you need
Just Scrape all of the sites URLs, or use its XML/Sitemap crawler functionality.
Then load those into the link extractor plugin, opt in for either internal or external, or both and let it loose.
You'll get the links you need
SuperLinks
Elite Member
- Jul 14, 2008
- 2,903
- 852
Is that for the page, or the whole site?
Checkmate
BANNED
- Aug 9, 2010
- 1,658
- 687
ScrapeBox can do this will the addon called "link extractor"
hotleatherdreams
Registered Member
- Mar 29, 2010
- 78
- 18
yes SB does. check the addons menu for link extractor. im bummed i cant get into my computer right now to use it
- May 1, 2010
- 2,442
- 470
scrapebox can do next to anything