1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

[METHOD]Remove Pages From Da Guegle Cache

Discussion in 'BlackHat Lounge' started by N0H4T, Sep 9, 2010.

  1. N0H4T

    N0H4T Junior Member

    Joined:
    Sep 14, 2008
    Messages:
    109
    Likes Received:
    89
    Occupation:
    Full Time Internet Marketer
    Location:
    Frankfurt, Germany
    Greetings All,

    I'm sure some of you, like I have, had problems at one stage or another with unwanted pages cached in the Guegle search results.

    Well to get rid of them see below.

    (Hit Thanks if you like this!!)

    Greetings,

    Dave
    Here is the short Version:-

    1) Set up a Gmail account if you don't have one and login to "Google's Webmaster Tools"

    2) Add your site into the webmaster tools and verify your ownership of the website, by adding a snippet of code into the header.

    3) To remove single pages or whole directorys go to "Site configuration - Crawler access", for detailed instructions make a search within your google webmaster tools private area.

    4) You can also affect the rate that your site or page is accessed by the crawlers someplace here.

    The long version is below:-

    Code:
    Remove a page or site from Google's search results
    
    
    If you want to remove content from Google's search results, that content should first be removed from the web or blocked from search engines. We run into a lot of people who think that Google runs the web and controls all the sites on it, but that's really not the case. The sites in Google's search results are controlled by those sites' webmasters.
    
    To remove content (including a snippet, title, page content, or an entire URL or site) from search results, the site owner?whether it's you or somebody else?has a few options. The site owner can remove the concerning information from the page, take the page down from the web entirely, or indicate that Google shouldn't crawl or index the page. There are varying requirements depending on the type of content you want to remove, and these are described below. Want to remove an image from search results? Check this out first.
    
    After these changes are made and Google has crawled the site again, the content should naturally drop out of the Google index.
    
    However, if you need to urgently remove your site's content from search results, or if you need to remove Google's cached copy of a page that has already changed on the website or stop Google from showing results for a page that has been taken down completely, you can use Google's removal tool to expedite the process. To use the tool, you'll need to follow certain requirements, detailed below.
    
        * If you own the site, you'll need to make the changes to your website yourself and then request removal of the problematic page from Google's search results using the URL removal tool in Webmaster Tools.
        * If you don't own the site, your first step is to contact the site's webmaster and request that the content is removed. (Note that depending on the type of removal?see below?some other changes may also be necessary). Once the changes have been made, you can request removal of the content from appearing as a cache copy or snippet in Google's search results by using the public URL removal tool. (It bears repeating: The site owner?whether it's you or somebody else?must have first made the required changes to the site, or this process will not work to remove the content from search results.)
    
    The URL removal tool is designed for URLs that urgently need to be removed, such as URLs that accidentally expose confidential data. If you recently made changes to your site, Google?s crawlers will see this when recrawling URLs, and any outdated pages will naturally drop out of our search results over time. There?s no need to request an urgent removal.
    
    You may also find the following articles useful:
    
        * Removing information from Blogger, Maps, YouTube, and other Google products
        * Personal information in search results
    
    Why do you want to remove content from search results?
    The page has changed and I want the outdated information removed
    
    If the content of the page (whether the content itself, or the page title or other information) has changed, the changes will be reflected in Google's index the next time we crawl your site and refresh our index. However, until that time, Google's cache may still contain the original content and as a result this content can still appear in search results. In this case, you can request that the cached version of the page be removed from search results. This will also remove the page snippet.
    
    Before using the URL removal tool, you'll need to make sure that the content of the page has been updated, either by you or by the owner of the site. If this step is not taken, your removal request will not be successful. (If you never want the page to be cached and you are the webmaster, add a noarchive meta tag to the <head> section of the page.)
    
    Note that the title and URL of the page may still appear in search results until Google crawls the site again. (You can see how often Google crawls your site by checking the Crawl Stats page in Webmaster Tools.)
    If you own the site
    
    To request removal of the outdated cached version of the page from search results:
    
       1. Verify your ownership of the site in Webmaster Tools.
       2. On the Webmaster Tools home page, click the site you want.
       3. On the Dashboard, click Site configuration in the left-hand navigation.
       4. Click Crawler access, and then click Remove URL.
       5. Click New removal request.
       6. Type the URL of the page you want removed, and then click Continue. Note that the URL is case-sensitive?you will need to submit the URL using exactly the same characters and the same capitalization that the site uses. How to find the right URL.
       7. Select Remove page from cache only.
       8. Select the checkbox to confirm that you have completed the requirements listed in this article, and then click Submit Request.
    
    If you don't own the site
    
    Contact the webmaster of the site, and request that the content of the page be updated. If this step is not taken and the page is not updated, you will not be able to use this tool to process your removal request. (If you never want the page to be cached, ask the webmaster to add a noarchive meta tag to the <head> section of the page.)
    
       1. Go to http://www.google.com/webmasters/tools/removals.
       2. If you're not immediately taken to the 'Create a new request' page, click New removal request.
       3. Type the URL of the webpage that's been changed (not the Google search results URL or cached page URL). Note that the URL is case-sensitive?you will need to submit the URL using exactly the same characters and the same capitalization that the site uses. How to find the right URL. Click Continue.
       4. On the next page, click Content has already been removed from the page.
       5. Fill in the form. Be sure to include the following info:
              * The words that have been removed from that page. None of the wordsyou submit should appear anywhere on the live page. (You don't need to include common words such as "and", "the", etc.) For example, if you want to remove a cached page containing the words "Susan's cats are ugly hairballs", and the page still contains the words "Susan's cats are beautiful puffballs", a cache removal request for "Susan's cats are ugly" will be unsuccessful (because the terms "Susan's cats are" remain on the page). But a cache removal request for "ugly hairballs" will work, as long as those terms do not appear elsewhere on the page. To maximize your chances of success, it's often easiest to just enter one word that you're sure no longer appears anywhere on the page. 
       6. Click Submit Request.
    
    Once your request has been processed and it's found that the submitted word(s) no longer appear on the page, the search result will no longer show a snippet, nor will the cached page be available. The title and the URL of the page will still be visible, and the entry may still appear in search results for searches related to the content that has been removed (such as searches for [ugly hairballs]), even if those words no longer appear in the snippet. However, once the page has been re-crawled and re-indexed, the updated snippet and cached page can be visible in our search results.
    
    Keep in mind that we will need to verify removal of the word(s) by viewing the page. If the page no longer exists and the server is returning a proper 404 or 410 HTTP response code so that we are unable to view the page, you may be better off requesting removal of the entire page.
    
    If you are a webmaster and want to prevent the page title and URL from appearing in search results, you should create a request to completely remove the page from search results. See below for more details.
    I want to completely remove a page from search results
    
    The first step requires the webmaster to make a change. If you own the site, you'll need to do ONE of the actions listed below. If you don't own the site, contact the webmaster and request that one of these changes be made. (If one of these changes isn't made, you will not be able to use this tool to process your removal request.)
    
        * If the page no longer exists, make sure that the server returns a 404 (Not Found) or 410 (Gone) HTTP status code. This will tell Google that the page is gone and that it should no longer appear in search results.
        * If the page still exists but you don't want it to appear in search results, use robots.txt to prevent Google from crawling it. Note that in general, even if a URL is disallowed by robots.txt we may still index the page if we find its URL on another site. However, Google won't index the page if it's blocked in robots.txt and there's an active removal request for the page.
        * Alternatively, you can use a noindex meta tag. When we see this tag on a page, Google will completely drop the page from our search results, even if other pages link to it. This is a good solution if you don't have direct access to the site server. (You will need to be able to edit the HTML source of the page).
    
    In addition, if you want a non-HTML file (for example, a downloadable PDF) to be removed from search results, you or the webmaster should ensure that the file is removed from the server. Once it's gone, use the process below to request that the page is completely removed from search results.
    If you own the site
    
       1. Verify your ownership of the site in Webmaster Tools.
       2. On the Webmaster Tools home page, click the site you want.
       3. On the Dashboard, click Site configuration in the left-hand navigation.
       4. Click Crawler access, and then click Remove URL.
       5. Click New removal request.
       6. Type the URL of the page you want removed from search results (not the Google search results URL or cached page URL), and then click Continue. How to find the right URL. Note that the URL is case-sensitive?you will need to submit the URL using exactly the same characters and the same capitalization that the site uses.
       7. Click Remove page from search results and cache.
       8. Select the checkbox to confirm that you have completed the requirements listed in this article, and then click Submit Request.
    
    If you don't own the site
    
       1. Go to http://www.google.com/webmasters/tools/removals.
       2. If you're not immediately taken to the 'Create a new request' page, click New Removal Request.
       3. Type the URL of the webpage you want removed (not the Google search results URL or cached page URL). Note that the URL is case-sensitive?you will need to submit the URL using exactly the same characters and the same capitalization that the site uses. How to find the right URL. Click Continue.
       4. Click Webmaster has already blocked the page.
       5. Select the checkbox to confirm the requirements listed in this article have been completed, and then click Submit Request.
    
    I want to remove an entire site or the contents of a directory from search results
    
    If you own the site, you can verify your ownership in Webmaster Tools and use the verified URL removal tool to remove an entire directory from Google's search results.
    
    Before using the URL Removal Tool, you must use robots.txt to block crawler access to the directory (or, if you?re removing a site, to your whole site). (For more information about blocking search engines from confidential information, see Blocking Google.) Returning a 404 HTTP status code isn't enough, because it's possible for a directory to return a 404 status code, but still serve out files underneath it. Using robots.txt to block a directory ensures that all of its children are disallowed as well.
    
    Once you have completed one of the steps above, you can request removal of the directory and all of its contents from search results using the URL Removal Tool in Webmaster Tools.
    
       1. On the Webmaster Tools home page, click the site you want.
       2. On the Dashboard, click Site configuration in the left-hand navigation.
       3. Click Crawler access, and then click Remove URL.
       4. Click New removal request.
       5. Type the URL of the directory you want removed from search results and then click Continue. How to find the right URL. Note that the URL is case-sensitive?you will need to submit the URL using exactly the same characters and the same capitalization that the site uses. If you want to remove the whole site, you can leave this blank.
       6. Click Remove directory
       7. Select the checkbox to confirm that you have completed the requirements listed in this article, and then click Submit Request.
    
    Be careful when requesting removal of a site. The only reason you should request a site removal is when you want all the contents of a site permanently removed from Google?s index.
    
    Removing https://www.example.com will also remove http://www.example.com, as well as http://example.com and https://example.com.
    
    If you?re worried that your site may have a penalty, or you want to start from scratch after purchasing a domain from somebody else, we recommend filing a reconsideration request letting us know what you're worried about and what has changed. If your site has been hacked, check this article for recommendations.
    A site is publishing my confidential personal information
    
    If you find a page in Google search results that lists personal information such as your social security or credit card number, let us know using the links below. Google will contact the site's hosting company to request that the page be taken down from the web. We'll also take steps to remove the information from our search results.
    
    You don't want this information to be anywhere on the web. So even if Google removes it from our search results, make sure to contact the webmaster directly and tell him or her to remove your information immediately.
    
    You can report this content directly to Google if the website contains the following, and you have been unable to work directly with the site owner:
    
        * Your social security or government ID number
        * Your bank account or credit card number
        * An image of your handwritten signature
        * Your first and last name or the name of your business appearing on an adult content site that's spamming Google's search results.
    
    If you have concerns about other kinds of content appearing on third party sites, and you have been unable to contact the site's webmaster, please consult this page.
    
    
    Here is original page:

    Code:
    http://www.google.com/support/webmasters/bin/answer.py?hl=en&answer=164734
    
     
    • Thanks Thanks x 1