Google’s Two distinct things in SEO

Mar 28, 2019
Reaction score

Crawling or web crawling refers to an automated process through which search engines filtrate web pages for proper indexing.
Web crawlers go through web pages, look for relevant keywords, hyperlinks and content, and bring information back to the web servers for indexing.
As crawlers like Google Bots also go through other linked pages on websites, companies build sitemaps for better accessibility and navigation.
Crawling in SEO is the acquisition of data about a website.
Crawling is a process by which search engines crawler/ spiders/bots scan a website and collect details about each page: titles, images, keywords, other linked pages, etc. It also discovers updated content on the web, such as new sites or pages, changes to existing sites, and dead links.
According to Google
“The crawling process begins with a list of web addresses from past crawls and sitemaps provided by website owners. As our crawlers visit these websites, they use links on those sites to discover other pages.”


Indexing starts when the crawling process gets over during a search. Google uses crawling to collect pages relevant to the search queries, and creates index that includes specific words, or search terms and their locations.
Search engines answer queries of the users by looking up to the index and showing the most appropriate pages.In layman's terms, indexing is the process of adding web pages into Google search. Depending upon which meta tag you used (index or NO-index), Google will crawl and index your pages. A no-indextag means that that page will not be added to the web search's index

Spiders are also called as Crawlers or Google Bots. Spiders are used to crawl a website to index them in the search engines data base for a Quicker Access. Spiders are visits every website and crawls the data.
Googlebot is Google's web crawling bot (sometimes also called a "spider"). Crawling is the process by which Googlebot discovers new and updated pages to be added to the Google index. We use a huge set of computers to fetch (or "crawl") billions of pages on the web.
In the very simplest of definitions, cache is a snapshot of a web page that Google creates and stores after they have indexed a page. When pages are indexed, they are categorized and filed within Google's indexers, but they do not actively search though millions of web pages every time that page is called up.