NoIndex on http but not on https

havor99

havor99

Regular Member
Joined
Sep 27, 2023
Messages
302
Reaction score
109
Hello,

i have a website with https://ca.... that can be indexed, but if i crawl with bing, the http://ca... can not be indexed because of a "Noindex" in meta, but where can i change this site? i dont understand, i have only 1 site, and there is no "noindex".

Brgds
 
Advertise on BHW
can someone help, indexing via bing not possible
 
havor99 said:
can someone help, indexing via bing not possible
Click to expand...
Look for <meta name="robots" content="noindex" /> tag in the HTML of the HTTP version of your site or an HTTP header with "noindex". Go to HTTP version of your site and inspect with developer tools.

Another option is your web server might be configured to serve different content or headers. It might be a mistake resulting from default server configurations or specific rules set in your server configuration files (.htaccess for Apache, nginx.conf for Nginx). Check config files that handle HTTP requests.

If you're using CMS like Wordpress, it might be due to a plugin, specifically, one that handles SEO

Ideally all HTTP traffic should be redirected to HTTPS anyway.
 
Md Alex77 said:
interesting
Click to expand...
whats interesting?

havor99 said:
Hello,

i have a website with https://ca.... that can be indexed, but if i crawl with bing, the http://ca... can not be indexed because of a "Noindex" in meta, but where can i change this site? i dont understand, i have only 1 site, and there is no "noindex".

Brgds
Click to expand...
does it say no index in the meta or just assuming?
this is where i have to jump to a few assumptions.
either u have a 301 redirect, cloudflare htst redirect, metatag, or a server side only allow https.
now, my assumption is you have it set by cloudflare is htst(always use https)
google/bing will say there is a http page but will flag it as no index as the https should be indexed as its a redirect.
for SEO purposes, this is not an issue at all and wont affect anything at all aslong as the https is indexable.
 
If you have wordpress website find plugin that send many requests to Google for indexing your URLs.
 
AshOasis said:
Look for <meta name="robots" content="noindex" /> tag in the HTML of the HTTP version of your site or an HTTP header with "noindex". Go to HTTP version of your site and inspect with developer tools.

Another option is your web server might be configured to serve different content or headers. It might be a mistake resulting from default server configurations or specific rules set in your server configuration files (.htaccess for Apache, nginx.conf for Nginx). Check config files that handle HTTP requests.

If you're using CMS like Wordpress, it might be due to a plugin, specifically, one that handles SEO

Ideally all HTTP traffic should be redirected to HTTPS anyway.
Click to expand...
its hosted by namecheap, can you help with that?

status 200ok
keep-alive: timeout=5, max=100
x-powered-by: PHP/8.0.30
x-dns-prefetch-control: on
content-type: text/html; charset=UTF-8
link: <https://.....com/wp-json/>; rel="https://api.w.org/"
etag: "31365-1710244300;;;"
x-litespeed-cache: hit
date: Tue, 12 Mar 2024 12:22:04 GMT
server: LiteSpeed
x-turbo-charged-by: LiteSpeed
 
Carnaged said:
whats interesting?


does it say no index in the meta or just assuming?
this is where i have to jump to a few assumptions.
either u have a 301 redirect, cloudflare htst redirect, metatag, or a server side only allow https.
now, my assumption is you have it set by cloudflare is htst(always use https)
google/bing will say there is a http page but will flag it as no index as the https should be indexed as its a redirect.
for SEO purposes, this is not an issue at all and wont affect anything at all aslong as the https is indexable.
Click to expand...
hard to read, if you have no idea, google indexing is working, its only on bing

bing says: The page contains the 'noindex' directive either in a meta tag or in the HTTP header. If you want this page to appear and appear in Bing search results, you must remove the tag or HTTP header from the page.
 
havor99 said:
hard to read, if you have no idea, google indexing is working, its only on bing

bing says: The page contains the 'noindex' directive either in a meta tag or in the HTTP header. If you want this page to appear and appear in Bing search results, you must remove the tag or HTTP header from the page.
Click to expand...
hang on, so gsc is indexing http AND https? or is it redirecting and indexing https?
have a look at that first because thats not sounding right. gsc should have the same outcome.
 
Carnaged said:
hang on, so gsc is indexing http AND https? or is it redirecting and indexing https?
have a look at that first because thats not sounding right. gsc should have the same outcome.
Click to expand...
i think google will redirect, but i dont understand, because my site is https and not http or?

google is indexing, and has no problems.

if i go to url inspector, both are working in gsc
 
Carnaged said:
hang on, so gsc is indexing http AND https? or is it redirecting and indexing https?
have a look at that first because thats not sounding right. gsc should have the same outcome.
Click to expand...
litespeed cache can not be a problem or?
 
- There might be a robots meta tag with "noindex" on the HTTP version of your pages, even though you haven't explicitly set it. Check the HTML code of your HTTP pages (especially the <head> section) for any meta tags like <meta name="robots" content="noindex">.

- Some servers might have settings that automatically add "noindex" to HTTP requests. Check your server configuration or consult your hosting provider to see if there's anything related to robots.txt or meta tags for HTTP traffic.

- Since you only have one site, fixing the HTTP version should ensure both are indexed.
 
VictorSQ said:
- There might be a robots meta tag with "noindex" on the HTTP version of your pages, even though you haven't explicitly set it. Check the HTML code of your HTTP pages (especially the <head> section) for any meta tags like <meta name="robots" content="noindex">.

- Some servers might have settings that automatically add "noindex" to HTTP requests. Check your server configuration or consult your hosting provider to see if there's anything related to robots.txt or meta tags for HTTP traffic.

- Since you only have one site, fixing the HTTP version should ensure both are indexed.
Click to expand...
i got this message from namecheap:

According to my check, there are no server-side blocks and in the robots.txt file.

As for the HTTP header and tag block, please check the issue with the qualified specialist, also you can refer to some suggestions here: https://answers.microsoft.com/en-us...her-in-a/91d7e2fd-ffef-4662-86d0-037252aa102b

Unfortunately, we wont; be able to check the HTTP header or tags as it is out of our scope.
 
its solved !!!!!!

"Thanks for contacting Bing webmaster support.
I have reviewed your query and would like to inform you that the issue with the URL Inspection tool is occurred due to a temporary momentary problem. I'm happy to let you know that the issue has now been resolved."
 
Advertise on BHW
You must log in or register to reply here.
Sign up now!

Main Menu

Home Main Forum List Black Hat SEO White Hat SEO BHW Newbie Guide Blogging Black Hat Tools Social Media Downloads

Marketplace

Account Selling Content / Copywriting EBooks / Methods Hosting Misc Proxies For Sale SEO - Link building SEO - Packages Social Media Social Media - Panels Web Design More

Making Money

Affiliate Programs Hire a Freelancer IM Journeys Making Money Pay Per Click Site Flipping Want to Buy

BlackHat World

Dispute Resolution Forum Suggestions & Feedback Introductions Lounge
Back
Top