Scrapebox bulk link checker - $10 for the solution

M1ndfluX

M1ndfluX

Banned - Selling via PM
Joined
Dec 23, 2009
Messages
1,129
Reaction score
882
Hey all,


I have a client that wants me to submit aprox 5k of his urls.

Now the posting is not a problem but the link checking is obviously soooo sloooowwww.

Now i wanted to know if there is some sort of shortcut for this.

All the urls are from the same domain so is there a way SB can detect all the live links from the same root url instead of checking all the innerpages on their own?

Maybe something like http://domain.com/# ( don't work lol ) but you get my drift.

Ten bucks in your paypal for the solution, if there is any.



Regards
 
Advertise on BHW
There is no way to do that, you would need a list of URL's the link is on in order to check them.

You could use the sitemap extractor addon to scrape a list of the sites pages if they have a sitemap, if not you could use the link extractor addon and set it to internal links only and scrape them that way. Then load them in the link checker.

Edit: Maybe i misunderstood and ritesh is on the right track, there's also "Match Domain Only" checkbox on the link checker.
 
Last edited:
Sweetfunny said:
There is no way to do that, you would need a list of URL's the link is on in order to check them.

You could use the sitemap extractor addon to scrape a list of the sites pages if they have a sitemap, if not you could use the link extractor addon and set it to internal links only and scrape them that way. Then load them in the link checker.
Click to expand...

Hi Sweetfunny,

Thanks for the reply, i know how busy you are.

Maybe i don't get you correctly are maybe you did not understood me correctly but i have already a list of my client with just the urls ;)

Thanks!
 
ritesh said:
in website use only "http://domain" it should work
Click to expand...

Hi Ritesh,

Dude... So simple... So effective :D

Will send you a pm in a few secs so i can buy you a few beers.

Rep given too
 
M1ndfluX said:
Hey all,


I have a client that wants me to submit aprox 5k of his urls.

Now the posting is not a problem but the link checking is obviously soooo sloooowwww.

Now i wanted to know if there is some sort of shortcut for this.

All the urls are from the same domain so is there a way SB can detect all the live links from the same root url instead of checking all the innerpages on their own?

Maybe something like http://domain.com/# ( don't work lol ) but you get my drift.

Ten bucks in your paypal for the solution, if there is any.



Regards
Click to expand...



Hey Mindflux !

I would've made you a screenshot but I am on my Laptop at the momment.

When in the Link Checker in the middle bottom of the window there is a Checkbox and next to it, it says "Match Domain Only", you just have to click that and instead of quering a page 5000 times with :
CTRL+F www.page.com/1
CTRL+F www.page.com/2
ETC To 5000
It will just check the page with CTRL+F www.page.com

:)

Hope I helped you, if not send me a PM with your skype and I will do a screen share with you to show you how to do it ;)
 
Hi George!


Man i feel dumb atm lolz... Been working with SB since the beginning and for some reason i never tapped that box ghehehe.

Oh well, never to old to learn i guess :D

Thanks for the help bud!
 
@m1ndflux:

Tip #1:
just FYI, instead of checking for http://site, you should do: href="http://site
this will check for live links

Tip #2:
if you're posting links of multiple urls, from multiple domains, for example:
http://site1.com/page1
http://site1.com/page1
http://site6.com/page2
http://site5.com/page7
http://site4.com/page1
http://site1.com/page2

Best way to simplify this would be, copy and paste the whole list of these into scrapebox, then trim to root, and remove the duplicates - The end results would be:
http://site1.com
http://site4.com
http://site5.com
http://site6.com

Use notepad to replace all http:// with href="http://
Then copy and paste all these to the websites part of the linkchecker

Voila :)

~ixrumer
 
Hi IX,


Thanks for the feedback!

Just wondering, would adding the tag before the url increase the links found rate or what would be the point of this.

Thanks bud.
 
The point is to find live links.

What the link checker does, is to download the pages and search the html code for whatever you were putting in the websites part. By doing this, you are looking for the specific href attribute of the A tag, and that guarantees 'live links'.

~ixrumer
 
Thanks for the reply, i understand.


Ok, will implement your suggestion later on when i got more to find except easter eggs ;)

TY
 
I have problems with link extractor addon. I checked a page visually and see several external links. But when I use link extractor to check only external links, it can not find those external links. I checked this problem with several different websites and the results are always the same. Am I missing something or is there a bug with this addon?
 
Advertise on BHW
You must log in or register to reply here.
Sign up now!

Main Menu

Home Main Forum List Black Hat SEO White Hat SEO BHW Newbie Guide Blogging Black Hat Tools Social Networking Downloads

Marketplace

Account Selling Content / Copywriting Hosting Images, Logos & Videos Proxies For Sale SEO - Link building SEO - Packages Social Media Social Media - Panels Misc

Making Money

Affiliate Programs Hire a Freelancer Making Money Pay Per Click Site Flipping

BlackHatWorld

BHW Merch Forum Suggestions & Feedback Introductions Lounge Dispute Resolution

Other

Domain Name Forum IM Journeys Web Hosting Newsletter
Back
Top