sitemap generator needed for 300k+ links
- Thread starter nicker
- Start date
your site is based on htaccess or legit full hosted?
if full hosted you can use "xenu links sleught" then generate sitemap from accesslog with python google sitemap generator its really cool and fast but i have some htaccess files that are not user friendly with all links checkers so it wont work in my case
Hardmaster
BANNED
- Mar 23, 2008
- 96
- 25
i need such sitemap generator for my doorway pages too...
I used custom sitemap generator built with PHP for my lyrics site. http://www.48g.net with Sitemap Index, because Google not recommends includng more than 50K in a single sitemap file.
for 300K link you will definetely need to use sitemap index file, and I advice you to not to use all the URL once. because it might cause your site to de-index from google index.
for 300K link you will definetely need to use sitemap index file, and I advice you to not to use all the URL once. because it might cause your site to de-index from google index.
every program i ve tested is creating 50k sitemaps
for 300k links i use it sitemap index and use it and ping before creating page - its helping mi get indexed faster.
eNdl
BANNED
- Jul 7, 2007
- 305
- 118
The script works very well for me but I'm on a dedicated server so I can tweak my memory and php execution time on the server for the php script to accomodate the long delay of developing the sitemaps. For a website this guy who created this thread is talking about then a shared hosting WON'T WORK! You will get your account closed or script disabled immediately.
I have alot of pages also and it takes about a day and a half to generate the sitemaps. The really cool part about the script is that I can set the sitemap to only generate only 30,000 urls per sitemap, which puts me under the 10mb size limit and 50,000 urls per sitemap limit that Google has for sitemaps. It also has cron job capability.
Plus the technical support is good and forum support is pretty active. For 29.99, it's a good buy.
it wont work on htaccess parsed content
as you can see in my topic:
/on the begining/
"i was trying a1sitemap..."
and your link is a1 sitemap ....
yes. its the newest version +patch (which sould fix your problem not to safe the sitemap)
its also working on big sites. and it doesnt freeze. it maybe looks like because your mouse is working but you can notice its still collectiong more links and going to generate it. so on a 300k DB you prolly will need some hours to generate a sitemap at all.
its also working on big sites. and it doesnt freeze. it maybe looks like because your mouse is working but you can notice its still collectiong more links and going to generate it. so on a 300k DB you prolly will need some hours to generate a sitemap at all.