@ techbui, feel free to PM me if you've got any questions on this method.
cheers
thank you for the offer johnnyc; i'll definitely take you up on it if i come across any problems.
@ techbui, feel free to PM me if you've got any questions on this method.
cheers
I thought I made a mistake.
I replace all (website) with the domain name using notepad + +
Just trying to use the original file without replacement, and it was no problem.
I will try again.
Thank you for the guide.
This is probably a stupid questionbut how do you break up the 33,000 text file up exactly? I tried highlighting and dragging to try and copy/past it to another text file but God forbid if I sneeze and my hand comes off the mouse.
Anyone have a less retarded way to break up that file?
Most of the URLs in the 33k file aren't working anymore so I crawled my own sites using the Alexa top 1M list, scrapebox and a selfmade app for filtering/cleaning the results using regex patterns. Got about 60k URLs that passed the scrapebox linkchecker yesterday and fired them through the rapid indexer. I got a huge traffic spike (about 1500 pageviews), most of them were bots that crawled my site. So I think this is very good for indexing new sites or for pushing the alexa rank.