1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Indexing and Crawling

Discussion in 'White Hat SEO' started by andersonbruce, May 11, 2015.

Thread Status:
Not open for further replies.
  1. andersonbruce

    andersonbruce Newbie

    Joined:
    Apr 27, 2015
    Messages:
    23
    Likes Received:
    3
    What is the difference between Indexing and Crawling?
     
  2. asap1

    asap1 BANNED BANNED

    Joined:
    Mar 25, 2013
    Messages:
    4,961
    Likes Received:
    3,185
    Crawling is when google bot comes to your page.

    Index is when the page is actually index in google, you can check if a url is index by typing "site:" in front of the url

    Example - site:yoursite.com

    Google bot first crawls a page and then the url is indexed if google bot thinks its worthy, google bot will not index every url it crawls.
     
    • Thanks Thanks x 2
  3. Vik Pathania

    Vik Pathania Regular Member

    Joined:
    Oct 13, 2014
    Messages:
    273
    Likes Received:
    54
    Gender:
    Male
    Occupation:
    Digital Marketing Specialist
    Location:
    New Delhi
    Crawling means the search engine robot crawl or fetch the web pages while Indexing means search engine robot crawl the web pages, saved the information and it appear in the search engine.
     
    • Thanks Thanks x 1
  4. clevercrazy11

    clevercrazy11 Jr. VIP Jr. VIP

    Joined:
    Feb 14, 2015
    Messages:
    223
    Likes Received:
    159
    In easy language you read the book that is crawling, and when you memorize the content in mind that is indexing.
     
  5. asap1

    asap1 BANNED BANNED

    Joined:
    Mar 25, 2013
    Messages:
    4,961
    Likes Received:
    3,185
    *Westbrook face* What!!!!!????
     
  6. bartosimpsonio

    bartosimpsonio Jr. VIP Jr. VIP Premium Member

    Joined:
    Mar 21, 2013
    Messages:
    12,492
    Likes Received:
    11,190
    Occupation:
    CHEAP
    Location:
    DATASETS
    Home Page:
    Here's what crawling is.

    [​IMG]
     
    • Thanks Thanks x 3
  7. mickyfu

    mickyfu Jr. VIP Jr. VIP

    Joined:
    Dec 14, 2011
    Messages:
    7,222
    Likes Received:
    20,794
    Occupation:
    King Of Crypto C
    Location:
    Solihull Young Offenders
    Is it you can get a fuck crawling curbs but you can't indexing them?
     
  8. freefillerforms

    freefillerforms Newbie

    Joined:
    May 11, 2015
    Messages:
    5
    Likes Received:
    0
    Like others have explained, crawling means google found your links, and indexing means it has chosen to include it within their database of search results after crawling it. So, crawling can be 100% but indexing may not.
     
  9. Zwielicht

    Zwielicht Moderator Staff Member Moderator Jr. VIP

    Joined:
    Aug 31, 2013
    Messages:
    7,142
    Likes Received:
    12,602
    Gender:
    Male
    Occupation:
    Reaper
    Location:
    Riverside, California
    Home Page:
    I was trying to look for something funny for indexing, but I couldn't find anything. :detective
     
  10. iAuthority

    iAuthority Jr. VIP Jr. VIP

    Joined:
    Jan 20, 2013
    Messages:
    2,120
    Likes Received:
    268
    Gender:
    Male
    Occupation:
    SEO,Link Building,Blogging.
    Home Page:
    Crawling takes place when there is a successful fetching of unique URIs which can be traced from valid links from other web pages.
    Indexing takes place after a crawled URIs are processed. Note that there may be several URIs that are crawled but there could be fewer of them whose content will be processed through indexing
     
  11. Go4vps

    Go4vps Junior Member

    Joined:
    Mar 19, 2015
    Messages:
    123
    Likes Received:
    8
    Occupation:
    Server administrator professional
    Location:
    Inside the server
    Home Page:
    Indexing and Crawling is the basic process, which is used by Google. First bots will test your URL and check all the parameter which is needed for the website to be indexed in Google. And once the crawling is over the website URL will index in Google.
     
  12. rushmediaph

    rushmediaph Newbie

    Joined:
    Jul 7, 2017
    Messages:
    8
    Likes Received:
    2
    now i have answers..lol thanks guys!
     
  13. Linkzo

    Linkzo Jr. VIP Jr. VIP

    Joined:
    Jun 20, 2015
    Messages:
    1,077
    Likes Received:
    205
    Google bot crawls the web to process information.Data collected during crawling it then sorts and analysis URL's to make indexation decision.Simple indexation terms a other name database which used by search engine,if a site is not indexed then users won't get it via search engine box.
     
Thread Status:
Not open for further replies.