REQ: Scrapebox page scanner footprints

I think Scrapebox Page Scanner would actually be a great way to filter URLs and reduce the list to URLs that GSA SER can actually post to. I suppose this will be possibly greatly increase the success rate and efficiency of GSA SER.

If someone has a list of footprints for all (or many, or a few) of the platforms that GSA SER can post to for usage with SB page scanner, it would be really great if you could give that.

Thanks.

Well you can just go into your GSA folder under program files and go to the engines folder. There you will find each engine. Just look for like


page must have1=href="signup.php"|Powered by <a href="http://www.articledashboard.com">Article Dashboard</a>|<p class="center small">© 2005-2011 Article Dashboard|class="formsubmitart"
page must have2=login.php"|action=login2submitart.php|submitarticles.php"|Powered by <a href="http://www.articledashboard.com">Article Dashboard</a>|<p class="center small">© 2005-2011 Article Dashboard|class="formsubmitart"
page must have3=submitarticles.php"|Powered by <a href="http://www.articledashboard.com">Article Dashboard</a>|<p class="center small">© 2005-2011 Article Dashboard|class="formsubmitart"



That is your footprints that GSA uses to qualify a page, so the page scanner could do the same.

BUT before you run off and spend hours doing that, GSA SER already has this functionality built in. Just go to program options >> advanced >> tools >> Import Urls (identify platform and sort in). That will load each page, and discard the ones that GSA can't post to and then save the ones it can post to, separated by platform, in the identified global folder.

So the page scanner can load the page, check it and sort them, or GSA can load the page check them and sort them. But with Scrapebox you have to copy out all the engine def files and build the mask file so it can work. I think anyone will tell you I think Scrapebox is an amazing tool worth its weight in gold, but I think even the Scrapebox developer would tell you that there isn't much sense in reinventing the wheel.

Wow ok thanks so much Loopline. This is the first time I am seeing something called "Tools" in GSA-SER, and it sure has a truckload of cool options.

Ha, yes it has a lot of useful tools in there.

Just wanted to mention a stand alone for this is coming soon. *teaser screenshot*

Awesome stuff santos!

Santos, will this standalone app be faster than SER at identifying sites? Because SER actually seems to be a bit slow at this.

Monie said:

Santos, will this standalone app be faster than SER at identifying sites? Because SER actually seems to be a bit slow at this.

Click to expand...

Yes, it's pretty fast for sure and you can set how ever many threads you want for each project and can be running multiple identify and sort in projects at the same time.

When will that tool be available?

TrevorB said:

When will that tool be available?

Click to expand...

No exact ETA but it will be very soon. Maybe +- couple weeks.

That's nice Santos. This will surely improve efficiency of any SER setup.

i just discovered that running an identified list (with 10 private proxies and 150 threads) gives me 45 LPM versus just 25 LPM on a raw scraped list.

looking forward to having this feature.

would be great to have it