Bulk broken links checker

kafeelmirza

Newbie

May 9, 2013

23

3

• Sep 6, 2017

• #1

Hey,

Need some assistance with bulk check for broken back links.

I have over 200,000 scraped tumblr blogs which I want to check for 404.

However scrapebox alive check in v2 is slow and ...

I have also tried check links in the scrapebox v1.6.6 which seems to not work. Please help me out.

 

Nut-Nights

Elite Member

Executive VIP

Jr. VIP

Jun 20, 2013

11,506

8,914

• Sep 6, 2017

• #2

You are either using SB on pc with low config or you have done something wrong, SB can check 200k in few minutes.

 

W9go

Elite Member

May 16, 2011

5,841

1,308

• Sep 6, 2017

• #3

let sb run over night .....

 

kafeelmirza

Newbie

May 9, 2013

23

3

• Sep 6, 2017
• Thread Starter Thread Starter

• #4

Nut-Nights said:

You are either using SB on pc with low config or you have done something wrong, SB can check 200k in few minutes.

Click to expand...

Bro, the pc is good specs, I don't understand, especially with alive check addon, it starts off very fast like several URLs/s but then after an hour it slows down so much, I thought tumblr iteself was refusing requested and therefore limiting them so tried proxies, but no avail.

 

kafeelmirza

Newbie

May 9, 2013

23

3

• Sep 6, 2017
• Thread Starter Thread Starter

• #5

W9go said:

let sb run over night .....

Click to expand...

Tried that woke up and its barely checking any links at all, even with proxies enabled. It starts off fast but slows right off.

 

Nargil

Elite Member

Executive VIP

Jr. VIP

May 10, 2012

9,539

7,559

• Sep 6, 2017

• #6

There isn't anything faster than Alive Checker for this. If it's slow, then just set your threads higher, maximum is 200 I believe. I can go through 4 million tumblrs in a few hours. Not sure how else would I pull that off.

 

kafeelmirza

Newbie

May 9, 2013

23

3

• Sep 7, 2017
• Thread Starter Thread Starter

• #7

Thank you to all.

 

loopline

Elite Member

Jr. Executive VIP

Jr. VIP

Jan 25, 2009

6,378

3,774

• Sep 7, 2017

• #8

The vanity checker addon - which was built entirely for finding "expired" web 2.0s is more accurate and versatile for the task then the alive checker is. But as noted above, I know of nothing that is faster then Scrapebox. You may wish to try google public dns, as it could be your dns that is the bottle neck.