[GET FREE] My Wayback Machine Tools - Search, Site Scanner, Domain Auditor and Bulk Page Text Extractor

kaudo said:

Hi, Gentlemen,

The Wayback Machine (archive.org) is a great resource of information for every internet archaelogist. I personally, love it and use it intensely and extensively. However, most of you will probably agree with me that WM is not the most user friendly tool in the world. That´s why I developed a handful of tools that help me deal with WM. I used them myself but now I decided to make them public on a new domain which I registered for one of my juniors but he´s not interested in anything but music, games and girls. To cut it short there are 4 tools, all of them free.

https://smartial.net/smart-tools/wsearch.php
Searching WM has its limits but with the tool you can search archived sites with a main keyword and up to 5 additional keywords. Results are sortable by number of parameters (years, captures, pages).

View attachment 156291

https://smartial.net/smart-tools/wscanner.php

Enter a domain name and Scanner will scan WM and bring back all pages from that domain. You can limit the search to a single year if you wish so. You can copy all the results and sort/filter/whatever them in excel or other spreadsheet program for further use. Or you can click a single page and extract it´s text content. The tools spits out maximum of 100k pages. It is fine to have all the URLs of the pages side by side, as you can search within them by any keyword.

View attachment 156292

https://smartial.net/smart-tools/waudit.php

Maybe you want to buy a domain but you´re not sure if it is worth the money and effort... Over the years I found out that apart from e.g. ahrefs or semrush, you definitely need to check every domains history with WM. You have to. You can´t just trust a single tool when evaluating the domain.

WM domain auditor comes to your help. The tool checks the history of any archived domain, seeks for suspicious activity, calculates a score (0 + 100%) and prepares a year over year report. Don´t trust it blindly and do your due dilligence, Auditor is just a neat little helper, not a detective agency

View attachment 156293

fast forward to the end of the report...

View attachment 156296

https://smartial.net/smart-tools/wextractor.php

And finally the page text content extractor. Feed it with a list of URLs (e.g. those you´ve got from the WM Scanner above) and extract the articles. Maximum 50 URLs allowed but I advise you to divide your generous lists to even smaller chunks.
Extractor uses 2 extraction methods, one isbased on "readability.php" (search GITHUB) and it extracts the articles from a blog like websites, the other one extracts broader content (article + navigation + etc...), you should use it if the first method fails.

View attachment 156298

That is all gentlemen and Merry Christmas to all of you - aspiring internet billionaires!

Click to expand...

minniemouse said:

These wonder tools like not working anymore, any alternative?

Click to expand...

kaudo said:

Hi, Gentlemen,

The Wayback Machine (archive.org) is a great resource of information for every internet archaelogist. I personally, love it and use it intensely and extensively. However, most of you will probably agree with me that WM is not the most user friendly tool in the world. That´s why I developed a handful of tools that help me deal with WM. I used them myself but now I decided to make them public on a new domain which I registered for one of my juniors but he´s not interested in anything but music, games and girls. To cut it short there are 4 tools, all of them free.

https://smartial.net/smart-tools/wsearch.php
Searching WM has its limits but with the tool you can search archived sites with a main keyword and up to 5 additional keywords. Results are sortable by number of parameters (years, captures, pages).

View attachment 156291

https://smartial.net/smart-tools/wscanner.php

Enter a domain name and Scanner will scan WM and bring back all pages from that domain. You can limit the search to a single year if you wish so. You can copy all the results and sort/filter/whatever them in excel or other spreadsheet program for further use. Or you can click a single page and extract it´s text content. The tools spits out maximum of 100k pages. It is fine to have all the URLs of the pages side by side, as you can search within them by any keyword.

View attachment 156292

https://smartial.net/smart-tools/waudit.php

Maybe you want to buy a domain but you´re not sure if it is worth the money and effort... Over the years I found out that apart from e.g. ahrefs or semrush, you definitely need to check every domains history with WM. You have to. You can´t just trust a single tool when evaluating the domain.

WM domain auditor comes to your help. The tool checks the history of any archived domain, seeks for suspicious activity, calculates a score (0 + 100%) and prepares a year over year report. Don´t trust it blindly and do your due dilligence, Auditor is just a neat little helper, not a detective agency

View attachment 156293

fast forward to the end of the report...

View attachment 156296

https://smartial.net/smart-tools/wextractor.php

And finally the page text content extractor. Feed it with a list of URLs (e.g. those you´ve got from the WM Scanner above) and extract the articles. Maximum 50 URLs allowed but I advise you to divide your generous lists to even smaller chunks.
Extractor uses 2 extraction methods, one isbased on "readability.php" (search GITHUB) and it extracts the articles from a blog like websites, the other one extracts broader content (article + navigation + etc...), you should use it if the first method fails.

View attachment 156298

That is all gentlemen and Merry Christmas to all of you - aspiring internet billionaires!

Click to expand...

wannabegoodatseo said:

still working?

Click to expand...