Recent content by fedez

Hi NG_Neer, thanks for the help but that is not what I was after. Let me explain again. Say there is a domain, xyz.com. Now this domain has a bunch of pages that BELONG to that domain such as xyz.com/contact-us xyz.com/about xyz.com/pages/product1 Some of these pages will no longer exist...

I want the pages that existed at some point but no longer do, pages that other websites may be linking to, I don't mean 404 pages, I mean 404ed pages.

So for example, say I have a domain xyz.com now that domain will have a bunch of 404 pages. I want to know all of (or as many as possible) of the 404s for that domain, and the same for an entire list of domains.

Sweet, will try that out.

Now this might actually work. I just got scrape box, what would I use to get the list of urls for each domain on scrapebox?

Can it really? All I see is the add list of urls option or the one url option. In either case when I run it, all thats limiting it is the depth of its search, otherwise it picks up all the links for every url and branches off them in turn.

Xenu just branches off randomly from a list of urls. I want a list of 404s form a list of domains, and the 404s being of those domains.

Screaming frog wont work, only checks one domain at a time, and not sure it even picks up all the 404s.

Xenu just looks at random links branching off any other link. How would xenu find a list of all 404s on a list of domains of 100 domains, and only those domains' 404s?

How would screaming frog do that for a list of 100 domains at a time?

Hey, So I want to be able to get the structure a website had before it's domain became expired. So for example, xyz.com, I want to know all of the pages and posts urls xyz.com/page1 etc that the website had. The only way I have thought of so far is using wayback machine. Because if I use a...

hmmm, Ive posted in freelancer section then, lets see.

I need a tool that I can put in a domain (or better yet a list of domains) and it goes through all of them and finds all the 404 pages on each domain. So for example. I put in xyz.com and it finds 2 404 pages on the website like xyz.com/page1404 xyz.com/page2404 So far my only idea has been...

I need a tool that I can put in a domain (or better yet a list of domains) and it goes through all of them and finds all the 404 pages on each domain. So for example. I put in xyz.com and it finds 2 404 pages on the website like xyz.com/page1404 xyz.com/page2404 So far my only idea has been...

Hey guys those dont work they only check broken links on one url at a time. I have a list of hundreds, I need to check broken links on each.