99% of indexing services are a scam

Luco said:
Since googlebot updates in same time with chrome is clear that they use the browser, since they index now things from inspect element it is clear that they use the bot as a browser, since they can now naivgate with the bot trough sites like a real user is clear enough for me to know that googlebot now it is in chrome. It was in past too but running with some old fixed chrome version.
Click to expand...

Interesting idea, but if you look where the googlebot visits from, it's always a particular ip address.
You think the gbot can be triggered within chrome?
 
Advertise on BHW
NO-CLUE-SEO said:
Interesting idea, but if you look where the googlebot visits from, it's always a particular ip address.
You think the gbot can be triggered within chrome?
Click to expand...
In theory yes, still testing it, but when I'm 100% sure I will make a post in jr vip section about all scenario.
 
Luco said:
Since googlebot updates in same time with chrome is clear that they use the browser, since they index now things from inspect element it is clear that they use the bot as a browser, since they can now naivgate with the bot trough sites like a real user is clear enough for me to know that googlebot now it is in chrome. It was in past too but running with some old fixed chrome version.
Click to expand...

Googlebot uses chrome but this no work from another side - chrome doesn't use googlebot. Chromium is just rendering engine for googlebot like for many other crawling bots, especially with headless mode. If you use Chrome you will not trigger googlebot to visit visited pages as this is against privacy rules. Can you imagine indexing all private pages (which are not protected from googlebot) but visible on internet and only owner knows his address?
 
ekapek said:
Googlebot uses chrome but this no work from another side - chrome doesn't use googlebot. Chromium is just rendering engine for googlebot like for many other crawling bots, especially with headless mode. If you use Chrome you will not trigger googlebot to visit visited pages as this is against privacy rules. Can you imagine indexing all private pages (which are not protected from googlebot) but visible on internet and only owner knows his address?
Click to expand...

That's what I think too.
 
ekapek said:
(which are not protected from googlebot) but visible on internet and only owner knows his address?
Click to expand...
Yes, this happened to me while using chrome with google dns settings.
 
Luco said:
Yes, this happened to me while using chrome with google dns settings.
Click to expand...

DNS servers doesn't know full address but only host, so I will look for another reason. Hosts (like .com, .org and many others) are also available on many public lists listed at google, so googlebot can find them.
 
You can try posting the link in a new youtube video, they get indexed within half an hour
 
Luco said:
Yes, this happened to me while using chrome with google dns settings.
Click to expand...

interesting, i think maybe google dns is the key here.

For years i have been generating static html sites on my own servers, i visit them a lot with chrome for testing and have never noticed google-bot coming out of nowhere.

Curious to read about your findings.
 
ghengis_khan said:
interesting, i think maybe google dns is the key here.

For years i have been generating static html sites on my own servers, i visit them a lot with chrome for testing and have never noticed google-bot coming out of nowhere.

Curious to read about your findings.
Click to expand...
you can test on your way too, cause it is easy, make a subdomain, not public, private one but not blocked for robots, set google dns, add some content on that subdomain or edit something on it while using google dns, don't use wordpress cause wordpress it is easy to index it, use some simple php on index. Bot will come on it.
 
Luco said:
you can test on your way too, cause it is easy, make a subdomain, not public, private one but not blocked for robots, set google dns, add some content on that subdomain or edit something on it while using google dns, don't use wordpress cause wordpress it is easy to index it, use some simple php on index. Bot will come on it.
Click to expand...

Are you saying just change the network settings to 8.8.8.8 and use chrome to browse the link you are trying to index?
 
NO-CLUE-SEO said:
Are you saying just change the network settings to 8.8.8.8 and use chrome to browse the link you are trying to index?
Click to expand...
I think too that this is what he is saying :D

Will be trying this out tonight
 
I used to use many of them back in the day, I'm surprised to see a thread like this as they've been not working for the past 2yrs. And it's not even about google bot crawling the page, the goal is to index them, not get them crawled, even if they're crawled 80%-90% don't get indexed anymore.
 
side note here come index, let's say you already index those urls

is ok to index again or don't serve any purpose since already indexed?
 
Luco said:
you can test on your way too, cause it is easy, make a subdomain, not public, private one but not blocked for robots, set google dns, add some content on that subdomain or edit something on it while using google dns, don't use wordpress cause wordpress it is easy to index it, use some simple php on index. Bot will come on it.
Click to expand...

Made 20 subdomains :

no links from external sources
static HTML (no wordpress or CMS)
never before seen before


Only indexing I will try is to browse the subdomains on my VPS using google DNS.

Every hour or so I will refresh.
 
Luco said:
you can test on your way too, cause it is easy, make a subdomain, not public, private one but not blocked for robots, set google dns, add some content on that subdomain or edit something on it while using google dns, don't use wordpress cause wordpress it is easy to index it, use some simple php on index. Bot will come on it.
Click to expand...

Luco one more question : How did you monitor the spiders ?
 
Luco said:
you can test on your way too, cause it is easy, make a subdomain, not public, private one but not blocked for robots, set google dns, add some content on that subdomain or edit something on it while using google dns, don't use wordpress cause wordpress it is easy to index it, use some simple php on index. Bot will come on it.
Click to expand...

Tested this on 20 different subdomains on 5 different root domains.

Visited many different times from multiple machines using google DNS

After 24 hours no spiders/bots/anything

I'm considering this method not working until I see with my own eyes that it works :p

nevertheless : will update the thread if bots come
 
Advertise on BHW
You must log in or register to reply here.
Sign up now!

Main Menu

Home Main Forum List Black Hat SEO White Hat SEO BHW Newbie Guide Blogging Black Hat Tools Social Media Downloads

Marketplace

Account Selling Content / Copywriting EBooks / Methods Hosting Misc Proxies For Sale SEO - Link building SEO - Packages Social Media Social Media - Panels Web Design More

Making Money

Affiliate Programs Hire a Freelancer IM Journeys Making Money Pay Per Click Site Flipping Want to Buy

BlackHat World

Dispute Resolution Forum Suggestions & Feedback Introductions Lounge
Back
Top