1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Unable to generate a proper sitemap file

Discussion in 'Black Hat SEO' started by Renard, May 23, 2012.

  1. Renard

    Renard Junior Member

    Joined:
    Apr 12, 2012
    Messages:
    129
    Likes Received:
    27
    Location:
    BHW
    Hello Guys,

    I am unable to create a proper sitemap for my new website http://goo.gl/a9xwP

    When I generate the sitemap, it only generate the main pages, none of the pages in each section (x pages) are showing in the file

    Are there any special tools that I need to use to this kind of websites ?

    Thank you,
    Much appreciated :)
     
  2. caitlin

    caitlin Junior Member

    Joined:
    Feb 16, 2010
    Messages:
    168
    Likes Received:
    72
    Without knowing how you are trying to generate the sitemap none of us will know why your site is not being crawled by the generator script. How many pages do you have? Is everything linked to starting on the home page? Do you have any no index in the headers of the other pages?

    Anything blocked in the robots.txt file?

    It could be any number of things...

    You think you have enough keywords on that site??? Sheesh man, looks a bit over-done to me... You may fix your sitemap issue but I'd venture to say at some point you are going to have an indexing issue.
     
  3. Renard

    Renard Junior Member

    Joined:
    Apr 12, 2012
    Messages:
    129
    Likes Received:
    27
    Location:
    BHW
    The website is already indexed over a month ago, and many test pages have been crawled.
    To start I have addition 30 pages that don't get in the sitemap (for some reason I still ignor and I need help)
    Nothing is blocked in robotx.txt, I don't have any no index on any of the pages neither

    I have enough keywords on the site. The content on the main is hidden thus you can't see it. You'll be able to see it only using the source. I am very confident.

    Anyone else have any idea ?
     
  4. markhenry121

    markhenry121 Elite Member

    Joined:
    Oct 14, 2011
    Messages:
    2,149
    Likes Received:
    239
    That's a site xml-sitemaps.com, Here you can just put url and click start button , then you got various format sitemap results.
     
  5. Renard

    Renard Junior Member

    Joined:
    Apr 12, 2012
    Messages:
    129
    Likes Received:
    27
    Location:
    BHW
    I used that same site to create the xml file.
    I didn't quiet understand what you mean by various format sitemap results...

    Not all the pages show up there. I am using joomla, does it matter ?
     
  6. queenmery

    queenmery Power Member

    Joined:
    Jan 18, 2011
    Messages:
    501
    Likes Received:
    30
    Occupation:
    Student
    Location:
    BANGLADESH
    How many pages do you have on your site? xml-sitemaps.com can make sitemap of 500 pages. Is you new pages are linked to main page?
     
  7. Renard

    Renard Junior Member

    Joined:
    Apr 12, 2012
    Messages:
    129
    Likes Received:
    27
    Location:
    BHW
    I dont't have over 30 pages. It is brand new.
    But none of the other pages are related to the main page...should they be ? And are there any reason or any thumb of rule for that ?

    Thanks
     
  8. caitlin

    caitlin Junior Member

    Joined:
    Feb 16, 2010
    Messages:
    168
    Likes Received:
    72
    If you only have 30 pages then why do you need a sitemap? Google should be able to crawl that with zero effort unless you have a poor link structure. I have a site with over 20,000 pages and no sitemap and I am on the first page for my niche. All you need is good link structure so google can find the stuff. Hidden text? You don't think you are asking for it? Yea good luck with that. I had an h1 hidden and got my ass handed to me.
     
  9. Renard

    Renard Junior Member

    Joined:
    Apr 12, 2012
    Messages:
    129
    Likes Received:
    27
    Location:
    BHW
    Hey caitlin, I always though a sitemap would help in SEO (ok not so much, but why not have a push?)
    I am expecting many pages to be created with time, I don't know how many.

    Can you please tell me what would be a good link structure ? Are there any article you can refer me to ?

    Many Thanks!
     
  10. queenmery

    queenmery Power Member

    Joined:
    Jan 18, 2011
    Messages:
    501
    Likes Received:
    30
    Occupation:
    Student
    Location:
    BANGLADESH
    Listen, you may have 100 pages but every page must be connected with your main page (landing page) which we see when we visit http://goo.gl/a9xwP. If the pages are not connected with main pages then your sitemap will also be broken.

    I have tried to make your site' sitemap using xml-sitemap. After creating sitemap the report says:

    Created on:
    24 May 2012, 09:27
    Processing time:
    0:00:42s
    Pages indexed:
    22 (crawled: 47)
    Pages size:
    0.51Mb
    Broken links:
    None


    You can also view details from: http://www.xml-sitemaps.com/details-www.montrealsxlist.ca.html
     
  11. caitlin

    caitlin Junior Member

    Joined:
    Feb 16, 2010
    Messages:
    168
    Likes Received:
    72
    I think sitemaps are a waste of time for SEO, that's old school. I don't use them on any of the sites I have and I do just fine without them.

    Google makes recommendations to us to do this and that when in reality all we are doing is creating shit for them to test their ideas on. Once that idea of theirs looses steam, so does the recommendation.

    I am not in business to help Google test it's ideas, I do what works in the least amount of time. A sitemap is just something else I need to maintain and tolerate it burning up CPU time on my server... and for what? To create a link that is a link to everything on my site?

    I already did that with the HOME page. Screw Google and their BS ideas... Rel=n0follow, author=.. all that stupid crap.
     
  12. Aty

    Aty Jr. VIP Jr. VIP

    Joined:
    Jan 27, 2011
    Messages:
    5,410
    Likes Received:
    3,698
    Home Page:
  13. desiblast

    desiblast Junior Member

    Joined:
    Nov 23, 2010
    Messages:
    150
    Likes Received:
    62
    I third xml-sitemaps.com. Been using it for a while, it's perfect for sites that don't auto generate sitemaps
     
  14. Mountaineer

    Mountaineer Senior Member

    Joined:
    Oct 14, 2011
    Messages:
    912
    Likes Received:
    149
    I also use one of several free sitemap generation tools. They are pretty spot on always. The best one is xml-sitemaps.com as recommended by several members.
     
    • Thanks Thanks x 1
  15. queenmery

    queenmery Power Member

    Joined:
    Jan 18, 2011
    Messages:
    501
    Likes Received:
    30
    Occupation:
    Student
    Location:
    BANGLADESH
    Does xml-sitemap auto generates sitemap for you? If yes then how would I check xml-sitemap has generated sitemap for your site automatically?