1. This website uses cookies to improve service and provide a tailored user experience. By using this site, you agree to this use. See our Cookie Policy.
    Dismiss Notice

Help remove indexed posts

Discussion in 'White Hat SEO' started by cham rox, Mar 20, 2018.

Tags:
  1. cham rox

    cham rox Power Member

    Joined:
    Dec 8, 2016
    Messages:
    631
    Likes Received:
    103
    Gender:
    Male
    Hi all,

    Recently I’ve noticied that my site has more than 200 indexed pages when I do a google search using Site:sitename.com

    There were category pages, tags pages and most importantly the attachment pages. (A separate page created for each image I have uploaded. That is the worst thing as It did not have any text. Just a headline and an image)

    So instantly I have changed the settings on yoast amd re generated the sitemap excluding those pages. Now my sitemap only has posts amd pages which I need to be show on google. Then I resubmitted the sitemap to the google.

    That is one week ago and yet I can see those jusk pages which is indexed on google and those are showing on the google search. How long will it take to remove those from google search amd google index? Or do I need to do do any more work to remove them?
     
  2. Zshan

    Zshan Jr. VIP Jr. VIP

    Joined:
    Jun 28, 2012
    Messages:
    568
    Likes Received:
    176
    You can delete those pages from Google webmaster tool
     
    • Thanks Thanks x 1
  3. cham rox

    cham rox Power Member

    Joined:
    Dec 8, 2016
    Messages:
    631
    Likes Received:
    103
    Gender:
    Male
    there are about 200 pages.
    My concern is when I update those pages with noindex tag, will the eventually get removed from google index? Then how long will it take normally?
     
  4. cham rox

    cham rox Power Member

    Joined:
    Dec 8, 2016
    Messages:
    631
    Likes Received:
    103
    Gender:
    Male
    My problem is,
    1. I have already indexed pages (200+) which has thin or duplicate content. They were already in the sitemap.
    2. Now I have made them noindex (added noindex tag) and removed them from the sitemap.
    3. But seems now g bots is not crawling them as they are not on the sitemap and so g0ogle is not removing them on their index.

    I want to remove these pages from the big G index.

    According to this link, https://support.google.com/webmasters/answer/93710?hl=en&ref_topic=4598466 I can use fetch as big G to crawl these pages again and show him that they are noindex. But there is a practical problem as I have more than 200 pages.

    I need to know is there's any other way I can do this.

    Hope you guys are clear.
     
  5. wblteam

    wblteam Jr. VIP Jr. VIP Premium Member

    Joined:
    Jul 21, 2014
    Messages:
    564
    Likes Received:
    156
    Home Page:
  6. ss1180

    ss1180 Jr. VIP Jr. VIP

    Joined:
    Feb 6, 2018
    Messages:
    727
    Likes Received:
    102
    Gender:
    Male
    Occupation:
    SEO Expert
    Location:
    India
    Dear if you will use noindex then they will take up to 3 months.
    You can manually send to google to remove that pages by webmaster tools.
    You can use robots.txt to not to index your tag, images and other pages which you want.
    Use yoast seo plugin there is feature to solve these problems.
     
  7. cham rox

    cham rox Power Member

    Joined:
    Dec 8, 2016
    Messages:
    631
    Likes Received:
    103
    Gender:
    Male
    thanks. I read it already. My concern is its difficult to delete all the 200+ links manually.

    thanks. I will check yoast again to see whether I have missed anything
     
  8. emilyjohnson

    emilyjohnson Newbie

    Joined:
    Mar 21, 2018
    Messages:
    2
    Likes Received:
    1
    Gender:
    Female
    Ofcourse, you can do it by simply adding meta robots tag in the <head> section of your webpage, this tag avoids spiders to crawl the webpage. Here is the syntax:
    <meta name="robots" content="noindex, follow">

    This tag will not index your page in the search engines but follows the content on the page. And if you dont want search engines to follow the content also, you can add the below tag:

    <meta name="robots" content="noindex, nofollow">

    Thanks
    Emily
     
  9. cham rox

    cham rox Power Member

    Joined:
    Dec 8, 2016
    Messages:
    631
    Likes Received:
    103
    Gender:
    Male
    Hi Emily,

    Thanks for the reply. I have already done that. But my problem is for the already indexed pages, google will see the no-index tag when it crawls the page again. But with the noindex tag, that page will not be included in the sitemap so that google will not find it to crawl again to see the no-index tag. This is somewhat chicken and egg problem. Hope you are clear about my problem now.
     
  10. cham rox

    cham rox Power Member

    Joined:
    Dec 8, 2016
    Messages:
    631
    Likes Received:
    103
    Gender:
    Male
    Ok. I got fixed it by myself. I will post what I have done here hoping it will help someone in future.

    First I scraped all the links of my site indexed on g0ogle. You can use site:yourdomain.com search query for this. And this will help to get the url https://www.labnol.org/internet/google-web-scraping/28450/

    Then I manually removed them using webmaster tools. And within one day, big G removed all the unnecessary links from its index.

    Make sure you have noindexed all the pages and remove them from the sitemap