Also what is a good crawl rate? Currently they're at like 50 per day but they aren't indexing for shit. I had an old one which isn't working any more either but when it was it used to get like 400-600 crawls p/d IIRC. Now SB causes a short spike in spiders but it's just that, a very short spike then they drop rapidly again. How do I get the bots coming in high rates on a consistent basis? I've done all the usual bullcrap- sb blasting, ping, rss, bmarking. Even the feeds were good quality but still didn't seem to make a diff.