Question about URL removals and crawl budget

upmhh20 · Oct 18, 2023

My website has too many URL's and because the website is pretty new the rate of indexing of new pages is very slow.

I came across this guide from ahrefs
https://ahrefs.com/blog/remove-urls-from-google/
according to this guide , if users don't need access to the page then I can just delete it.

So my plan is just delete the pages and update the new web sitemap.

Other option is to put no index tag on these pages or maybe redirect from these old URLs o other URLs?

whats your opinion?

MisaPh · Oct 19, 2023

upmhh20 said:
Trang web của tôi có quá nhiều URL và vì trang web còn khá mới nên tốc độ lập chỉ mục các trang mới rất chậm.

Tôi đã xem được hướng dẫn này từ ahrefs
https://ahrefs.com/blog/remove-urls-from-google/
Theo hướng dẫn này, nếu người dùng không cần truy cập vào trang thì tôi có thể xóa nó đi.

Vì vậy kế hoạch của tôi chỉ là xóa các trang này và cập nhật sơ đồ trang web mới.

Tùy chọn khác là không đặt thẻ chỉ mục trên các trang này hoặc có thể chuyển hướng từ các URL cũ này sang các URL khác?

ý kiến của bạn là gì?

I'm not sure if I can help you, but I can share some of my personal experiences after SEOing some new websites. In the past 1-2 years, Google's indexing process has become increasingly challenging for new websites.

I have a few new websites where I write a substantial amount of content (30-40 articles per month). After some time, I noticed that a large number of articles were not getting indexed. So, I manually submitted them in Google Search Console. However, I observed a phenomenon as follows.

When I indexed these 20 pages, after a while, Google would index them. But there would be some other similar articles that lost their index. I continued to discover them and resubmitted them in Google Search Console. The situation was resolved, and then it repeated as described above.

I found that most of the content on the website had decent quality, but the internal linking was not logical. Additionally, I hadn't focused on building website authority, so it seemed like Google wasn't favoring me.

After that, I focused on off-page optimization to improve the website's credibility. I noticed a clear change in the website's Domain Authority (DA), and after a few months, the rate of indexed articles improved. For example, previously, there were always around 70 articles not indexed on the website, but now that number has decreased to 15.

I think that if you feel on-page optimization is already good enough, it's essential to focus more on off-page SEO

upmhh20 · Oct 20, 2023

MisaPh said:
I'm not sure if I can help you, but I can share some of my personal experiences after SEOing some new websites. In the past 1-2 years, Google's indexing process has become increasingly challenging for new websites.

I have a few new websites where I write a substantial amount of content (30-40 articles per month). After some time, I noticed that a large number of articles were not getting indexed. So, I manually submitted them in Google Search Console. However, I observed a phenomenon as follows.

When I indexed these 20 pages, after a while, Google would index them. But there would be some other similar articles that lost their index. I continued to discover them and resubmitted them in Google Search Console. The situation was resolved, and then it repeated as described above.

I found that most of the content on the website had decent quality, but the internal linking was not logical. Additionally, I hadn't focused on building website authority, so it seemed like Google wasn't favoring me.

After that, I focused on off-page optimization to improve the website's credibility. I noticed a clear change in the website's Domain Authority (DA), and after a few months, the rate of indexed articles improved. For example, previously, there were always around 70 articles not indexed on the website, but now that number has decreased to 15.

I think that if you feel on-page optimization is already good enough, it's essential to focus more on off-page SEO

Thank you.
From my experience, I tend not to force too much manual indexing as when you force indexing too much google doesn't like that.

from what DR for those websites did you see the change? also mind if I ask you some SEO questions in private?

1SEOWarrior · Oct 20, 2023

If there are useless pages then delete that would be the best decision.

MisaPh · Oct 20, 2023

upmhh20 said:
Thank you.
From my experience, I tend not to force too much manual indexing as when you force indexing too much google doesn't like that.

from what DR for those websites did you see the change? also mind if I ask you some SEO questions in private?

The DR (Domain Rating) of the website before and after optimizing off-page through social media only differs by a tiny 2 points (10 - 12). However, I've noticed a significant improvement in the likelihood of post indexing. Despite undergoing multiple updates throughout the year, there were no signs of changes in the index (DR remained the same) until I observed the increase in DR. Upon rechecking the post indexes, I noticed this change.

In my opinion, increasing DR is not the primary goal for boosting keyword rankings in SEO, regardless of the approach. Instead, the key is to take actions that enhance the overall credibility of the brand, which is the way to improve website rankings. Of course, the increase in DR is one of the measures of this

NeedMyLink · Oct 20, 2023

If those URLs have no value, trash 'em and refresh your sitemap. Got backlinks or traffic? 301 redirect. "Noindex" still eats crawl budget. Did a mix of deletes and redirects for a client last year, worked solid. Evaluate each URL's worth before action.

upmhh20 · Oct 21, 2023

maxmayer said:
If those URLs have no value, trash 'em and refresh your sitemap. Got backlinks or traffic? 301 redirect. "Noindex" still eats crawl budget. Did a mix of deletes and redirects for a client last year, worked solid. Evaluate each URL's worth before action.

Yea from the ahrefs guide this seems like the best strategy. delete and in some cases if the traffic important the 301

I deleted most of the pages and updated my sitemap.

I accidentally removed one significant page that had 1k traffic monthly. unforrutantely it was unindexed and I assume I lost ranking to it
, I'll try to reindexed it.

MisaPh · Oct 22, 2023

maxmayer said:
If those URLs have no value, trash 'em and refresh your sitemap. Got backlinks or traffic? 301 redirect. "Noindex" still eats crawl budget. Did a mix of deletes and redirects for a client last year, worked solid. Evaluate each URL's worth before action.

If I delete thousands of pages that have no value, no traffic, and obviously no suitable replacements on the website, should I redirect all of them to the homepage, and do I need to remove those URLs in Google Search Console again?

upmhh20 · Oct 24, 2023

MisaPh said:
If I delete thousands of pages that have no value, no traffic, and obviously no suitable replacements on the website, should I redirect all of them to the homepage, and do I need to remove those URLs in Google Search Console again?

no just delete them and update the sitemap

upmhh20 · Oct 24, 2023

MisaPh said:
If I delete thousands of pages that have no value, no traffic, and obviously no suitable replacements on the website, should I redirect all of them to the homepage, and do I need to remove those URLs in Google Search Console again?

question , I accidently deleted url which had traffic and ranking and it got unindexed. I indxed it back but lot all ranking. is it possible to recover this?

She Hulk · Oct 25, 2023

If those URLs have no value then delete them mate but if you got backlinks or traffic then use them for 301 redirect, Check each URL's before you delete them.

Question about URL removals and crawl budget

upmhh20

Junior Member

MisaPh

Newbie

upmhh20

Junior Member

1SEOWarrior

Elite Member

MisaPh

Newbie

NeedMyLink

Elite Member

upmhh20

Junior Member

MisaPh

Newbie

upmhh20

Junior Member

upmhh20

Junior Member

She Hulk

Elite Member

Main Menu

Marketplace

Making Money

BlackHat World