Finding your sites 404's with scrapebox

[NeVeREire]

We bought an old site with 1000's of pages .

Google is saying we ahve over 15000 404's - we want to redirect these pages to pages with equal content.

However while google says we have over 15000 404's it's not giving us a list of these pages. We don't have the old pages either.

Is there a way to find any URL a site has ever had ?

We have scrapebox but not sure we can do this with it. @loopline would you be able to help answer that ?

Thanks

 

[loopline]

We bought an old site with 1000's of pages .

Google is saying we ahve over 15000 404's - we want to redirect these pages to pages with equal content.

However while google says we have over 15000 404's it's not giving us a list of these pages. We don't have the old pages either.

Is there a way to find any URL a site has ever had ?

We have scrapebox but not sure we can do this with it. @loopline would you be able to help answer that ?

Thanks

Does https://archive.org/ have it?

If so you could get it from there. If you have the expired domain finder in scrapebox, it has an archive.org downloader.

at least that would get the content and perhaps help you with the url structure.

If you don't have the list of urls to redirect though, thats trickier. Im not an htaccess expert, but you might be able to do something based on keywords in the url structure being redirected to a url with a similar keyword in the structure. Not sure, perhaps thats beyond regex, but else javascript might do it.

You could use the broken links checker addon on the site, and let it find any broken links, as perhaps that would help, not sure.

 

[Lauren11]

If you have yoast it will save all the 404 links. If those 404 urls still in search results you can try site:domain.com to get all the index links then check for the 404 errors.

 

[davids355]

I don’t know how to do it with sb but I guess you can scrape the results of a site:site.com search and then check the results. Deduct your active pages and you’ll be left with the 404 list.

I’ve had someone do this on my behalf, using Scrapebox, so I’m sure it’s doable.

If there were 404s that are no longer indexed, I wouldn’t worry about this (unless, as loopline said, you can get the full site structure and content from archive.org).

 

[Lauren11]

I don’t know how to do it with sb but I guess you can scrape the results of a site:site.com search and then check the results. Deduct your active pages and you’ll be left with the 404 list.

I’ve had someone do this on my behalf, using Scrapebox, so I’m sure it’s doable.

If there were 404s that are no longer indexed, I wouldn’t worry about this (unless, as loopline said, you can get the full site structure and content from archive.org).

Yes you can scrape urls using SB. Sb also have an addon to check 404 url checker. Just check loopline videos in your tube.

 

[alanleo818]

Click “Your Sites” and select a .txt file with yourDomain or Domains