Let's see who knows their indexing black hat magic

jamie3000

Elite Member
Executive VIP
Jr. VIP
Joined
Jun 30, 2014
Messages
13,772
Reaction score
5,228
I've been examining a website that is only 4 months old, has a weak backlink profile but has 6 million pages indexed and is getting tons of traffic...

So Google obviously is naturally crawling all those pages. I've had mass page sites before on scalable cloud infrastructure and new sites don't have the crawl budget to get all that indexed so quick.

All I can think of is he's got tons of throw away domains and he's 301'ing the Google bot from those domains to his website and he's triggering the requests with the indexing API. In a similar way to how omega works.

Who knows their indexing shit and can throw some ideas in?
 
Have you checked their social shares? They might be creating social media posts through automation to index pages.
 
Have you checked their social shares? They might be creating social media posts through automation to index pages.

Interesting. Does that work on a large scale? How would that work in practice? I'd force Google to index loads of Twitter accounts then tweet the URLs?
 
Oh boy, Subbed!! :D
 
Interesting. Does that work on a large scale? How would that work in practice? I'd force Google to index loads of Twitter accounts then tweet the URLs?
That used to work 5-6 months ago. I have a personal Facebook page that I created only to index parasites. Nowadays, Facebook alone is not working for index. I tried Omega indexer recently for a project but not even a single link indexed. I don't think it'll work if they use similar strategy like omega indexer. We need to see what else works. I'm currently spamdexing which takes 3-4 days to index with over 80% index rate.
 
I meant to put obviously isn't indexing above btw lol

@Starblazer what size sites are you indexing?
 
Social networks work perfectly in my case.

Of course, with much smaller numbers.

I can't claim, but I think that if everything was set up in the right way, I don't think there would be a problem with larger numbers.

I have few old FB pages [not profiles], 200 - 10k+ followers, Twitter, Pinterest, YouTube, etc.

It works...
 
I've been examining a website that is only 4 months old, has a weak backlink profile but has 6 million pages indexed and is getting tons of traffic...

So Google obviously is naturally crawling all those pages. ...
Is the site a secret to look at what they do? For that number of pages I don't believe they use external indexing. Rather it is clever internal interlinking or second option - hidden redirect from old domain.
 
How often are they adding content to the website? Google loves fresh content and will crawl and index a website often if it is posting content reguarly.
 
Yes, social sites do work better for indexing sometimes. If the page is popular and the link is shared then each time the website will be crawled when the user clicks the links.
 
I've been examining a website that is only 4 months old, has a weak backlink profile but has 6 million pages indexed and is getting tons of traffic...

So Google obviously is naturally crawling all those pages. I've had mass page sites before on scalable cloud infrastructure and new sites don't have the crawl budget to get all that indexed so quick.

All I can think of is he's got tons of throw away domains and he's 301'ing the Google bot from those domains to his website and he's triggering the requests with the indexing API. In a similar way to how omega works.

Who knows their indexing shit and can throw some ideas in?
Make your site into a google news site. They post alot and get indexed in an hour
 
So it's not true?
If so, then that's false advertisement.
I was knowing this it is a title so before using it, I marked his poll as service not working

About indexing I think one should automate a free php forum and give google bot and spider access to crawl the links within the post. It was helping a lot. But, yeah no idea about large scale that you mentioned.

How about submitting a site map? or feeding it to the google bot.
 
Back
Top