Google API indexing alternatives?

M

Mazaaa1

Newbie
Joined
Sep 26, 2024
Messages
5
Reaction score
2
Hi guys,

I've been indexing +150k pages daily using the google API indexer with multiple accounts , now that it does not work , is their anyone with solutions to index this amout of page daily at low cost?
 
Advertise on BHW
I'm also troubled by the deactivation of the indexing API, as I too have hundreds of thousands of pages waiting to be indexed by Google. However, I recently discovered that one of my websites, which was hacked by Japanese hackers and filled with countless spam pages, is being crawled by Googlebot at a rate of several dozen URLs per minute. These spam URLs generated by the hackers are being fetched by Googlebot, likely through some kind of API or method that submits URLs to Google, notifying Googlebot to crawl them. I've studied this for a long time, but I still haven't figured out how they are submitting large numbers of URLs to Google and notifying Googlebot to crawl them.
Most of the googlebot UAs that visit are GoogleOther from mobile devices
USER AGENT: Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/128.0.6613.137 Mobile Safari/537.36 (compatible; GoogleOther)
or
USER AGENT: Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/128.0.6613.137 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
 
Nicholas L said:
I'm also troubled by the deactivation of the indexing API, as I too have hundreds of thousands of pages waiting to be indexed by Google. However, I recently discovered that one of my websites, which was hacked by Japanese hackers and filled with countless spam pages, is being crawled by Googlebot at a rate of several dozen URLs per minute. These spam URLs generated by the hackers are being fetched by Googlebot, likely through some kind of API or method that submits URLs to Google, notifying Googlebot to crawl them. I've studied this for a long time, but I still haven't figured out how they are submitting large numbers of URLs to Google and notifying Googlebot to crawl them.
Most of the googlebot UAs that visit are GoogleOther from mobile devices
USER AGENT: Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/128.0.6613.137 Mobile Safari/537.36 (compatible; GoogleOther)
or
USER AGENT: Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/128.0.6613.137 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
Click to expand...
When was that , are you sure it was not before the API got deactivated? , Maybe since they have multiples hacked domains , they can redirect all the googlebot to the new pages?
 
Since the website was hacked, there has been a constant surge of Googlebot activity accessing it. Even now, a large number of Googlebots are continuously requesting to crawl spam page URLs, with each Googlebot crawling a different URL. Since I started tracking the Googlebots, not a single one has visited the same spam URL twice. I used the SEMrush tool to check the site and found no evidence of spam backlinks or 301 redirects (this is a new domain with no backlinks). Therefore, I suspect that URLs are being submitted in bulk through some method, prompting Googlebots to crawl them (IP addresses have been verified as legitimate Googlebots, and the indexing speed is incredibly fast—by the time I noticed, over 500k spam pages had already been indexed).

Here are the recorded GoogleBot details:

  • IP: 66.249.66.13 | Hostname: crawl-66-249-66-13.googlebot.com | Referrer: NO REFERER
  • IP: 66.249.66.14 | Hostname: crawl-66-249-66-14.googlebot.com | Referrer: NO REFERER
  • IP: 66.249.66.15 | Hostname: crawl-66-249-66-15.googlebot.com | Referrer: NO REFERER
  • Mazaaa1 said:
    When was that , are you sure it was not before the API got deactivated? , Maybe since they have multiples hacked domains , they can redirect all the googlebot to the new pages?
    Click to expand...
 
It looks like they have massive googlebots probably from hacked domains and parasite work spamming with redirects, this is not the API IP google bot , so I dont think they use a specific tool.
 
Mazaaa1 said:
It looks like they have massive googlebots probably from hacked domains and parasite work spamming with redirects, this is not the API IP google bot , so I dont think they use a specific tool.
Click to expand...
I still tend to believe that they are submitting URLs to Google in some way, because after a whole day of research, I discovered a method that doesn't require external links but can still attract a Googlebot similar to theirs. However, my current tests show that the number of Googlebots attracted is far less than theirs. Now, I plan to switch to a new domain and test submitting a large number of URLs to Google.
 
Nicholas L said:
I still tend to believe that they are submitting URLs to Google in some way, because after a whole day of research, I discovered a method that doesn't require external links but can still attract a Googlebot similar to theirs. However, my current tests show that the number of Googlebots attracted is far less than theirs. Now, I plan to switch to a new domain and test submitting a large number of URLs to Google.
Click to expand...
The API didn't stop working. It has already been discussed here https://www.blackhatworld.com/seo/g...ng-with-the-new-website.1622109/post-18174315


But now not everyone can use it, and that's good, less garbage will become.
 
GoogSEO said:
The API didn't stop working. It has already been discussed here https://www.blackhatworld.com/seo/g...ng-with-the-new-website.1622109/post-18174315


But now not everyone can use it, and that's good, less garbage will become.
Click to expand...

Since the beginning everybody use it not for job posting,)
But now our dear friends GG say it will be consider as Spammy,
so as alway in SEO is about the dosage,)

But now i will wait before try it on my money sites...

Any real feedback /alternative is welcome?
Maybe automate GSC submission?
 
SelenaQuintanilla said:
Since the beginning everybody use it not for job posting,)
But now our dear friends GG say it will be consider as Spammy,
so as alway in SEO is about the dosage,)

But now i will wait before try it on my money sites...

Any real feedback /alternative is welcome?
Maybe automate GSC submission?
Click to expand...
You can feel free to use the current version of the indexing api. If you don't get blocked the first time you submit a URL, then everything is fine and you won't get any penalties or problems.
 
Mazaaa1 said:
Hi guys,

I've been indexing +150k pages daily using the google API indexer with multiple accounts , now that it does not work , is their anyone with solutions to index this amout of page daily at low cost?
Click to expand...
Try search console there is no other tool or indexing or try any ping service
 
Nicholas L said:
I still tend to believe that they are submitting URLs to Google in some way, because after a whole day of research, I discovered a method that doesn't require external links but can still attract a Googlebot similar to theirs. However, my current tests show that the number of Googlebots attracted is far less than theirs. Now, I plan to switch to a new domain and test submitting a large number of URLs to Google.
Click to expand...
sir , can i dm u ?
how can i reach you because i want to ask how does the method works
i can give some benefit too please reply me, how can i reach you
 
Many tools can send batches of URLs to some search engines, but the processing results may be different.
 
lorainefuko said:
Many tools can send batches of URLs to some search engines, but the processing results may be different.
Click to expand...
Yes, but I can request Google to send spiders to crawl pages in batches. I tested the new domain name and the old non-indexed domain name, and they can basically be indexed in Google site:xxx.xx within 24 hours.
 
Mazaaa1 said:
Hi guys,

I've been indexing +150k pages daily using the google API indexer with multiple accounts , now that it does not work , is their anyone with solutions to index this amout of page daily at low cost?
Click to expand...
the answer is google index API update
 
Advertise on BHW
You must log in or register to reply here.
Sign up now!

Main Menu

Home Main Forum List Black Hat SEO White Hat SEO BHW Newbie Guide Blogging Black Hat Tools Social Media Downloads

Marketplace

Account Selling Content / Copywriting EBooks / Methods Hosting Misc Proxies For Sale SEO - Link building SEO - Packages Social Media Social Media - Panels Web Design More

Making Money

Affiliate Programs Hire a Freelancer IM Journeys Making Money Pay Per Click Site Flipping Want to Buy

BlackHat World

Dispute Resolution Forum Suggestions & Feedback Introductions Lounge
Back
Top