Indexing 500k Pages from Automated Content Website

S

sudoapt

Newbie
Joined
Oct 10, 2021
Messages
26
Reaction score
10
Hey,

I have a user driven website with 500k+ pages. Each page contains a few products and descriptions pulled from Amazon/Walmart/Other big retailers.

The site I have is similar in structure to: http://bestreviews.guide/, but is targeting a different type of keyword. BestReviews.Guide manages to index new pages very fast and at scale with no backlinks.

I am hoping to index all of the pages (each one has 1-2k words), a unique introduction (100 words) and updates regularly (once every few days).

Do you have any advice on how to get the pages to index at scale?

I'm working on backlink building, but that's a slow process over a few months. Any quick tips on how to index?
 
Advertise on BHW
Anyone got any ideas? Does the indexing API from Google work? I read their docs and it seems to be specific to job postings?
 
You're going to have to be patient and wait. Google usually indexes sites with thousands of pages a few thousand at a time over the course of months, I know because I have such sites. I would focus on traffic and backlinks meanwhile. Think about it, why would Google or any other authority put 500k pages of a brand new website in their search engine right away? They want quality, they want to make sure this information is coming from a trustworthy source. There is no way around building up some level of trust, which takes time.
 
SEO is for the long run.
Better be patient op.
 
At this point, I think the indexing criteria is totally random for new sites

A vast majority of gibberish gets indexed really quick
 
Google News is working good for me. I have the same case using an almost similar strategy like you. Somehow most of my site working good with that. My indexing rate is 70-75%. But Google is not picking keywords. :(
 
Advertise on BHW
You must log in or register to reply here.
Sign up now!

Main Menu

Home Main Forum List Black Hat SEO White Hat SEO BHW Newbie Guide Blogging Black Hat Tools Social Media Downloads

Marketplace

Account Selling Content / Copywriting EBooks / Methods Hosting Misc Proxies For Sale SEO - Link building SEO - Packages Social Media Social Media - Panels Web Design More

Making Money

Affiliate Programs Hire a Freelancer IM Journeys Making Money Pay Per Click Site Flipping Want to Buy

BlackHat World

Dispute Resolution Forum Suggestions & Feedback Introductions Lounge
Back
Top