What is the difference between crawling and indexing

Absurtuk

Regular Member
Joined
Mar 1, 2013
Messages
237
Reaction score
31
Hey I've searched the entire forum for this question but nothing comes useful to me .
So , in many link indexing services they say "we are gonna crawl your backlink"
so what is the difference between crawling and indexing ?
Crawling like , google bot comes to your site and just fetch the data and not indexing your page?
 
Think of it like a book. The author of a book will spend time researching different areas of interest for his/her book. They are essentially crawling for data/information. They [The search-bots] see what's out on the internet (as it relates to your question), by crawling. As for the index, also like a book -- or what you'd find at the back of the book, will point to where on this particular website (that's been crawled), the information may be located. It's basically the SERPs' index, after they've crawled your site, that your site becomes added to. That is how you can type things into the search textboxes, to obtain the results of whatever it was you were searching for. Hope this helps. :-)
 
Crawling is that search engine spiders visit your website. Indexing is that they consider their visit worthwhile and record their visit in search engine.
 
Crawling occurs when the google robot traced URL from other pages and when it crawled in the url then it fetches its details like content, links etc and passed this info to other engines which is content filtration engine. If this filtration engine found the content useful then it index the url.

Conclusion: Crawler only visits the site and collect the details like content,links etc and then passed these info to content filtration engine. Then if content filtration engine founds the content useful then it will pass the content and url to the indexing engine which will further index the url.
 
As an aside, you can check indexing in google with the site:your domain.com operator

Bot crawling you can check in your server logs.
 
Crawling is the process of search engine crawler visits your site and fetch the data.
Indexing is actually positioning the fetched data in the search engine data base.
 
Back
Top