Maybe it's done already, but using PRstorm and hearing peoples problems, while looking over my own webstats, I come to think. All these damn spiders are plastering their website URL in my logs. I see google.com, yahoo.com, ask.com, and a crapload of others, mostly places I ping I believe.
Well they all pretty much get a FREE PASS to use my bandwidth, ping my site, sometimes hundreds of times, paste their URL, ALL through my logs.
Question is do these agent logs get posted on the internet like referral logs? Do websites leave referral stats at all?
Why not start a landing page with your own "search spider". Call it whatever you want for the niche your in. Compile a list of URLS you'd normally use for PRSTORM and let the spider lose. Do what they do, include the main url in the botname, agent, referral, just like they all do.
Sure spiders take up tons of Database space, but you don't have to store anything if you don't want, just provide the interface and a msg saying it's having issues.
Webmasters would not suspect you of spamming, since you are "clearly" a search service, and it was just your "bot".
Bots get clearance, WhyTF don't we use em, to leave our mark?
Let me know what would make this unplausable, cause I'm about to set up and try it out.
Get ready for AcaiBot, GoodHealthBot, etc.... from the best Acai Search engine on the net, and of course the search engine for all your GoodHealth needs...
Guess the question is... would these leave backlinks anywhere?
Well they all pretty much get a FREE PASS to use my bandwidth, ping my site, sometimes hundreds of times, paste their URL, ALL through my logs.
Question is do these agent logs get posted on the internet like referral logs? Do websites leave referral stats at all?
Why not start a landing page with your own "search spider". Call it whatever you want for the niche your in. Compile a list of URLS you'd normally use for PRSTORM and let the spider lose. Do what they do, include the main url in the botname, agent, referral, just like they all do.
Sure spiders take up tons of Database space, but you don't have to store anything if you don't want, just provide the interface and a msg saying it's having issues.
Webmasters would not suspect you of spamming, since you are "clearly" a search service, and it was just your "bot".
Bots get clearance, WhyTF don't we use em, to leave our mark?
Let me know what would make this unplausable, cause I'm about to set up and try it out.
Get ready for AcaiBot, GoodHealthBot, etc.... from the best Acai Search engine on the net, and of course the search engine for all your GoodHealth needs...
Guess the question is... would these leave backlinks anywhere?