You've been using Google Indexing API all wrong. Here's why!

Alexion

Banned - Shitlisted and did not do the right thing
Sep 9, 2021
1,456
3,788
Ok, sorry about that clickbait title, a small weekend joke.

But seriously, if you are using Indexing API to index stuff in volume(talking about spam blogs, auto blogs, PAA, etc) I just noticed something.
This only applies for people looking to index thousands of pages a day.

Out of laziness, I was submitting 100 links in one go(since it's the max per load) all the time.
I noticed today that if you send 100 links per request, around 40% get lost, or ignored.

I tracked 10 APIs, so that's about 2,000 pages sent to the API.
Around 800 got lost, the crawler never bothered to show up.

Now, I did some changes.
Created another google profile, created 10 GCP projects, and redid the operation.

This time, I sent only 10 pages / request.
Result?

100% links visited by a crawler. Like clockwork.

The problem isn't really with Google, but with the rank math script. When it doesn't get a reply, it resends the request.
This also wastes the number of requests from your daily quota.

So yeah, thought it's worth mentioning.
Trying to spread some karma in the universe, so good things come back to me, as I need a new on grid invertor.
 
@Alexion I have finally started using rank math after 8 months of indexing rate of less than 1% on a total of around 75 posts. I used rankmath indexing 2 days before on aound 15 URLS, now these show indexed in GSC but are not in Google search when using the URL search. Is it normal?
 
@Alexion I have finally started using rank math after 8 months of indexing rate of less than 1% on a total of around 75 posts. I used rankmath indexing 2 days before on aound 15 URLS, now these show indexed in GSC but are not in Google search when using the URL search. Is it normal?
Who knows what's normal and what's not these days?

But yeah, in my case as well, it takes about 1 to 4 days for an URL to show in google, even if it says indexed in GSC.
Some don't show up at all, but it's a small fraction, like 2%.

Send all your URLS to the API, don't waste time.
 
Send all your URLS to the API, don't waste time.
Thank you for the reply. I thought of sending them in small batches (10-15) to avoid any kind of penalty. I have few more questions

1) Have you done API indexing on a big scale like 75-100 posts in 1 day? and did it work?
2) Do you recommend sending social signals or any kind of backlinks during this period?
3) After showing it up on Google search, do any of your posts rank in the top 10 or does it take a few more weeks/months to settle rankings for them
4) Any more inputs that you have gained during this process?
 
Thank you for the reply. I thought of sending them in small batches (10-15) to avoid any kind of penalty. I have few more questions

1) Have you done API indexing on a big scale like 75-100 posts in 1 day? and did it work?
2) Do you recommend sending social signals or any kind of backlinks during this period?
3) After showing it up on Google search, do any of your posts rank in the top 10 or does it take a few more weeks/months to settle rankings for them
4) Any more inputs that you have gained during this process?
Please re read the first post on this thread.
It's mentioned I just sent 4,000 pages to the APIs. This was a thread for people with high volume sent to google, spam blogs, auto blogs, etc.
Has nothing to do with the other questions you are asking, as I am as clueless as you are.

I'm just interested in getting stuff indexed. The rest is unknown.
 
This seriously looks like autogenerated text
It's a joke about how those karma people tell you to do good things so good things come back to you.
I need a new on grid invertor as my old one broke. trying to make money come my way out of thin air simpsonio.
 
It's a joke about how those karma people tell you to do good things so good things come back to you.
I need a new on grid invertor as my old one broke. trying to make money come my way out of thin air simpsonio.
What do you use the inverter for? Savings?
 
What do you use the inverter for? Savings?
I think you call it grid-tie in the U.S. It's tied to the grid, injects energy into the house and back to the grid when I have excess, from solar PV.
https://en.wikipedia.org/wiki/Grid-connected_photovoltaic_power_system#:~:text=A%20grid%2Dconnected%20photovoltaic%20system,unit%20and%20grid%20connection%20equipment.
Had a good 8 years run with the old one. Ordered a new one recently, waiting for delivery.
 
Interesting, my website is in Gnews and i use the indexing api from Rankmath. 50% URls get indexed rest don't. Does this have to do with what you explained above?
 
It saves energy, and injects it back into the grid when there is excess.

It doesn't work if the grid has no power.

If you want one for a blackout, you need off grid + batteries.
 
@Alexion I am guessing you used 10 APIs for 10 different websites? Also, did you make 10 different google accounts for each key or did you create 10 different service accounts in the same google account for 10 different API keys?
I tracked 10 APIs, so that's about 2,000 pages sent to the API.
 
Google indexing api is for time sensitive content like news and job posts.
It's not for spam posts like paa. So no wonder it's not indexing and in some case algo penalty.
 
ah! thanks for the tip.

I've also found an 100% indexing trick, yes, 100% of even spammy one-line blogs, within 3 days in google-search results!!! (no its neither youtube method, nor google-news method, nor api indexation method)

I'm testing it for nearly 90+ days. The result is like 92% to 93% of the indexed posts/pages are retained in GSC and actual google search results and only 7% are de-listed at re-crawl. So I am right now testing the re-crawl indexation rate (again).

I'm testing on two different domains, one has 500 articles, other has 3560 articles, one is static/php and other is wordpress cms.

once I get concrete results I'll put up a post here to share with fellow members!
 
I noticed today that if you send 100 links per request, around 40% get lost, or ignored.
How long has this been going? I talked with @Sartre about this and he still does that much every day, and it's performing fine for him.
 
Back
Top
AdBlock Detected

We get it, advertisements are annoying!

Sure, ad-blocking software does a great job at blocking ads, but it also blocks useful features and essential functions on BlackHatWorld and other forums. These functions are unrelated to ads, such as internal links and images. For the best site experience please disable your AdBlocker.

I've Disabled AdBlock