Link Crawling Method

bluemagic · Nov 7, 2008

Hey guys,

I have several thousand URLs that are in NON hyperlinked form (They're in a text file) that need to hyperlinked.

I have a tool that can crawl through a site and get URLs in URL#TITLE form.

Do you guys have any ideas on how to get these non hyperlinked urls in hyperlinked form so that the tool can crawl?

bluemagic · Nov 7, 2008

Okay I should describe it more clearly. I have several 1000 web addresses like

http://g00gle.com

but they're not in hyperlink form. I need them to be links

I've tried copy and pasting into an ICQ conversation, and the links were made. However I have way too many URLs to keep doing that.

bluemagic · Nov 7, 2008

I need to do this very frequently.

matapples01 · Nov 7, 2008

Find: http://
Replace with: <a href="http://

Find: .com, .net, .org...etc
Replace: "></a>

dating101 · Nov 7, 2008

cant you just copy and paste into notepad and save the page as html, then open that file in a web browser?

That will convert to hyperlink.

glew · Nov 7, 2008

This is so funny cuz i had the same issue last night

You can use the find and replace method in notepad but the problem is at the end of the url. If you have .com/ or .org/ you can't just replace the slash with " because you will end up with href=http:/"/"

Not good! So the solution i cam up with was a macro for excel.....just create a macro and copy the code below and run it!

Code:

' Converts each text hyperlink selected into a working hyperlink
'
    For Each xCell In Selection
        ActiveSheet.Hyperlinks.Add Anchor:=xCell, Address:=xCell.Formula
    Next xCell
'

just make sure the list is one column! Worked for me

*zap* · Nov 7, 2008

Ok i think i can help with this
A small program i love as it has saved the day many times for me
Just google TextMorph its freeware
Install it
Then run the program
Click file scroll down to Mulitiple file Morph
This is the option you need to use
Click the next button
Then find the folder with all the text files in it
You have a lot of useful options to help you here
Add the files you want here then click next
Here you can set up the search and replace
Or what ever you like/need
Then click next again
HERE tick the Super Fast Morph box
Then click start and watch this baby fly

This is a most have in my tool box

Tilt4832 · Nov 7, 2008

The way I've done it is with a spreadsheet, you can also do anchor text.

=A1&A2&A3

stmadeveloper · Nov 8, 2008

why not do this with php - pretty easy if you have the urls one to a line.

Link Crawling Method

bluemagic

Regular Member

bluemagic

Regular Member

bluemagic

Regular Member

matapples01

Regular Member

dating101

Regular Member

glew

Junior Member

zap

Regular Member

Tilt4832

Regular Member

stmadeveloper

Registered Member

Main Menu

Marketplace

Making Money

BlackHatWorld

Other