ScrapeBox Forum Profile Sorting (Need to get the proper url for the register pages)

[lewi]

Hey,

I have gathered a list of around 10k forums so far (smallish list i know but just wanted to do some tests before i ended up with a huge list that i couldn't do anything with)

However the list has a mix of url's all pointing to different pages on different forums (some to profiles, others to the home pages and others to actual topics).

For my software what i need is to 'convert' these lists so that they give the direct url's to the sites register page.

How could i do this with scrapebox?

I thought about just using find and replace and trying /forum/register.php but not all sites are coded like that and some have changed the pages and names which i don't really want to miss out.

Plus im sure SB could find the pages somehow right?

Thanks

Lewi

 

[virtualc08]

I think this might help

http://www.blackhatworld.com/blackhat-seo/black-hat-seo-tools/230815-scrapebox-footprints.html

 

[crazyflx]

What kind of forums are they?

 

[lewi]

What kind of forums are they?

Well i have a mix list which i have been compiling manually for the last month from what people have shared around the net!

But the other lists i have are smf and vbulletin!

I suppose then each forum type has a different footprint for like 99% of their sites right? So then would a search and replace work?

Lewi

 

[mtime88]

uhh use the footprints in scrapebox to only scrape register pages...

along the lines of inurl:register.php

 

[lewi]

uhh use the footprints in scrapebox to only scrape register pages...

along the lines of inurl:register.php

So your saying use the site operator first to get all the links of the site and then filter looking just for the register.php pages?

Or are you saying just trim to the root domain and then use inurl on the root domains to find what should be the forum register url?

Probably a silly question but i am only running on a gold rush mind atm due to lack of sleep and loads of technical knowledge over the past 24 hours.

Lewi

 

[lewi]

Sorry for the bump but this seems to have got buried!

Lewi

 

[jb2008]

As above, you need to find the part of the register page url that is common to all register pages specifically, then use the inurl: operator to reflect that.

 

[cody41]

Do this: post up the list of forums, and i'll do my best to recompile the list with their registration pages.

 

[quadratic]

I assume that the list you have is composed of links from many different types of forums. The issue this presents is that there is not a common footprint for a registration page across all these as some may be on register.php, some may be /register/ etc.

Suggest you first separate out each type of forum. You can use Scrapebox for this - SweetFunny mentioned before that " The Link Checker in ScrapeBox is essentially a string checker, so it can check for anything in a pages source. "

So you could put something like: "Powered by vbulletin" etc into the text file which would normally hold the list of websites to check, use Scraprbox to check these 'links' on each of the urls you have recorded, and then export the list of url where the 'link' = the search string was found.

Once you have each forum type in a separate file you can use the registration url footprint for the specific forum type. Use Scrapebox to strip the urls down to the domain and then append the registration url onto the end of each domain.

 

[dandan]

NVM... sorted it out...