Expired Domain - built the Structure, can I disallow?

Rosath · Sep 30, 2023

Hi,

I'm done manually rebuilding the structure of an expired domain. I'm trying to keep the authority.

I'm wondering if I can disallow Google from crawling them or if this could have a negative impact.

They are not 100% identical. I replicated the site structure but not the design. There's commerce pages and stuff.

Do I need to include all these URLs in the sitemap?

Also: How long should I let it sit? Just until it's indexed is good or should I wait more before building content?

Steptoe · Sep 30, 2023

You don't want to disallow Google from crawling your pages, as that would mean they would drop out the index and not be accessible via search. You should include all valid urls in your sitemap. If your pages are currently not indexed, I would only add minimal new content until you see some pages in the index.

If the domain is not indexing at all, first check for things like robots.txt disallow directives, or noindex tags. If your expired domain has existing backlinks, you can try using indexers on them to help give indexing a kick up the backside which should knock on to your domain.

Rosath · Sep 30, 2023

Steptoe said:
You don't want to disallow Google from crawling your pages, as that would mean they would drop out the index and not be accessible via search. You should include all valid urls in your sitemap. If your pages are currently not indexed, I would only add minimal new content until you see some pages in the index.

If the domain is not indexing at all, first check for things like robots.txt disallow directives, or noindex tags. If your expired domain has existing backlinks, you can try using indexers on them to help give indexing a kick up the backside which should knock on to your domain.

Thanks! I guess I'll put everything in the sitemap and crawlable.

Crazy Monkey · Sep 30, 2023

Disallowing Google from crawling the rebuilt expired domain isn't advisable, as it may hinder the authority transfer process. Include all relevant URLs in the sitemap for indexing. Wait until it's indexed before building content, but ensure the structure and content align with Google's quality guidelines for best results.

Rahul_1506 · Sep 30, 2023

It's essential to allow Google to crawl your rebuilt site to maintain domain authority, so include all vital URLs in your sitemap. You don't need to wait to add new content. Start building and publishing as soon as the structure is ready, and use tools like Google Search Console to monitor indexing and spot any crawl errors. Your aim should be a smooth blend of legacy structure with fresh, relevant content to keep both Google and your audience engaged.

Rosath · Sep 30, 2023

Thanks guys. I was mostly asking because there are some brand products on the old website that I obviously cannot sell. That makes me a bit averse to leave the pages on, especially since they receive no juice

HustleTong · Sep 30, 2023

Delete dead pages and make sure google can crawl rest of the site

l0cke · Oct 1, 2023

Rosath said:
Hi,

I'm done manually rebuilding the structure of an expired domain. I'm trying to keep the authority.

I'm wondering if I can disallow Google from crawling them or if this could have a negative impact.

They are not 100% identical. I replicated the site structure but not the design. There's commerce pages and stuff.

Do I need to include all these URLs in the sitemap?

Also: How long should I let it sit? Just until it's indexed is good or should I wait more before building content?

You don't have to block Google from crawling your rebuilt domain if the content is unique, and it's a good idea to include all relevant URLs in the sitemap. It's best to wait a few weeks before actively adding more content after it's indexed.

Expired Domain - built the Structure, can I disallow?

Rosath

Regular Member

Steptoe

Elite Member

Rosath

Regular Member

Crazy Monkey

Elite Member

Rahul_1506

Junior Member

Rosath

Regular Member

HustleTong

Elite Member

l0cke

Elite Member

Main Menu

Marketplace

Making Money

BlackHat World