On-page SEO - Need some help

[bikashdaga]

I have around 10k Not Found (404) links, These pages aren't indexed or served on Google.

While debugging from where these URLs are generated, found out that Google Crawler is creating random URLs based on the articles.

for example, If I have an article on "Python Script for SEO", this particular article has a code snippet

like for example purpose:

import React, { Suspense } from 'react'

const LazyComponent1 = React.lazy(() => import('./OtherComponent1'))
const LazyComponent2 = React.lazy(() => import('./OtherComponent2'))
const LazyComponent3 = React.lazy(() => import('./OtherComponent3'))
const LazyComponent4 = React.lazy(() => import('./OtherComponent4'))

const MyComponent = () => (
  <div>
    <Suspense fallback={<div>Loading...Please Wait..</div>}>
      <LazyComponent1 />
      <LazyComponent2 />
      <LazyComponent3 />
      <LazyComponent4 />
    </Suspense>
  </div>
)

now the crawler has created these 404 URLs

1. https://www.example.com/topics/react/python-script-for-seo/Home/OtherComponent4
2. https://www.example.com/topics/react/python-script-for-seo/Home/OtherComponent3
3. https://www.example.com/topics/react/python-script-for-seo/Home/OtherComponent1
4. https://www.example.com/topics/react/python-script-for-seo/Home/OtherComponent2

Any idea why this is happening? why does Google frame 404 URLs on its own?


Any solution suggestions?

 

[tazarbm]

Any idea why this is happening? why does Google frame 404 URLs on its own?

no idea, but I've never heard of Google creating URLs for websites just to fuck those sites up. Something else might be at play here...

Try to add rel="canonical" into the header of this page and see if it fixes the 404 issues next time when google crawls this page. If this doesn't work, you've most likely been hacked (because I can't think of other logical reason)

 

[MrxCyberNet]

you can use or add rel canonical in the header mate ....and use 404 redirect plugin ...

 

[yalang]

Some of the most common causes of indexing issues are duplicate content without a proper canonical tag, blocked page access, incorrect robots.txt file, poorly implemented redirects, and rendering issues related to Javascript.

Our goal is to get the canonical version of every important page indexed.

Duplicate or alternate pages shouldn't be indexed. Having a page marked duplicate or alternate is usually a good thing; it means that we've found the canonical page and indexed it.

You can find the canonical for any URL by running the URL Inspection tool.

If you could pull out the index coverage report, which you can get by logging into Google search console, choose property, and then choose coverage under the index in the left nevigation.

It will tell you the whole story about indexation of the site. I think this problem has its roots in crawl anomaly, or your website was hacked by a competition.

 

[bikashdaga]

Some of the most common causes of indexing issues are duplicate content without a proper canonical tag, blocked page access, incorrect robots.txt file, poorly implemented redirects, and rendering issues related to Javascript.

Our goal is to get the https://support.google.com/webmasters/answer/139066#definition of every important page indexed.

Duplicate or alternate pages shouldn't be indexed. Having a page marked duplicate or alternate is usually a good thing; it means that we've found the canonical page and indexed it.

You can find the canonical for any URL by running the https://support.google.com/webmasters/answer/9012289.

If you could pull out the index coverage report, which you can get by logging into Google search console, choose property, and then choose coverage under the index in the left nevigation.

It will tell you the whole story about indexation of the site. I think this problem has its roots in crawl anomaly, or your website was hacked by a competition.

So this is the website I am talking about: https://www.scaler.com/topics/

All the things are perfectly implemented: Canonical, robots.txt, redirects, etc.

View attachment 281215


I am inspecting this URL: https://www.scaler.com/topics/react-native-webrtc/assets/VideoOff (This is created by Google Crawler, there is no such page present on the website)
View attachment 281216

Referring page:
https://www.scaler.com/topics/react-native-webrtc/ doesn't have such page in it.

it has a code snippet:

The highlighted one is the URL created by the Google Bot (https://www.scaler.com/topics/react-native-webrtc/assets/VideoOff)

and there are thousands of such URLs on Google Search Console.

Just for your reference tagging you guys too:

MrxCyberNet

tazarbm


Is it because of the Markdown format? all the articles are published in Markdown format.​

​

This is the first time I am facing this kind of issue, not sure how to fix this.

​