Something to extract URL's from a .txt file

[Kronz]

Basically I have a large .txt file that contains various URL's mixed with some text.

I want to extract those URL's.

I googled hard, but I couldn't find a free program that does that simple task.

Please help.

 

[mktanny]

Try this (you will need notepad ++) -- http://stackoverflow.com/a/8477855/3117013

 

[scriptdaddy]

You can use a regex for that easily, probably in python.

 

[todordonev]

Notepad++ and use regex in the find window (ctrl+f)
You can also google textmechanic and do the following:
Make new line before http
Replace empty space with new line (cause the urls are separated with empty space otherwise they will merge and wont work)
Remove lines that dont contain http
Remove duplicate lines.
Save to txt.

 

[Davidnrog]

I'll help you, Just pin me your .txt file..

 

[ItsBlinkHere]

Basically I have a large .txt file that contains various URL's mixed with some text.

I want to extract those URL's.

I googled hard, but I couldn't find a free program that does that simple task.

Please help.

Post a sample...it shouldn't be to hard to code up.

 

[tornadododo]

get application from the apple store

 

[seohosting]

If you are using google chrome you can download the "Jon's all in one domain tool" extension. Has a great simple domain cleaner built in.

You can also find a domain cleaner over at function.me

 

[hpasha]

put that txt file into scrapebox. it will extract the urls and then check their headers

 

[Wilson Grant Fisk]

try this: http://free.groupfetch.com/products/ugrab/index.php

 

[Aty]

or this: http://url-extractor.software.informer.com/download/

 

[Kronz]

try this:

Thank you very much. It saved me.

Only problem is it is a bit slow. I have been trying to process a 200MB file today and it hasn't even extracted 1/8 of the links in 5 hours.

or this:

Thanks, but this one crashes.

 

[Atomic76]

Is the text file in some sort of consistent format? Such as a comma separated or tab separated? If so, you can just paste it into Excel and do a Data > Text To Columns, and select what the delimiter is.

 

[prab1996]

pm i might do it for free if it will not consume much time. i do this type of work every day.
-=-

 

[COLDEXE]

I'll do this for free if you like, will only take a few minutes as I've written similar software. I've sent you a pm anyway mate.

 

[botrockets]

I have created very fast tool for such purpose. You can extract links from text file of any size.. may it be hundreds mbs, Gb or TB

here's screenshot :

See this post: http://www.blackhatworld.com/blackh...ur-reasonable-ideas-tools-15.html#post7408391