Recommend a web crawler to find all OBL

tg01

Power Member

Aug 23, 2007

762

264

• Jul 18, 2018

• #1

Hey Guys,

Does anyone know of a tool / service / script that I can send to a website and return all out bound links? I ask I’ve an idea up my sleeves for reverse engineering keyword research.

Thanks a lot.

 

terrycody

Elite Member

Sep 29, 2012

6,421

3,329

• Jul 18, 2018

• #2

Ahrefs.com ?

 

tg01

Power Member

Aug 23, 2007

762

264

• Jul 18, 2018
• Thread Starter Thread Starter

• #3

terrycody said:

Ahrefs.com ?

Click to expand...

Fair.

I was hoping to find a tool I can literally point at a site and scrape of root url's out.

 

dhia27

Power Member

Jan 26, 2016

753

355

• Jul 18, 2018

• #4

@tg01 Xenu's Link Sleuth

 

Yarharharharhar

Newbie

Sep 24, 2014

48

60

• Jul 18, 2018

• #5

Xenu link sleuth. It's free and with some creativity you can use it for other strategies; like broken link building and finding expired web2.0's/domains.

 

tg01

Power Member

Aug 23, 2007

762

264

• Jul 18, 2018
• Thread Starter Thread Starter

• #6

Thanks alot @Yarharharharhar and @dhia27
This should work a treat

 

seoz87

Supreme Member

Jr. VIP

Oct 31, 2008

1,226

838

• Jul 18, 2018

• #7

well somethign tellls me that navy seals will be more efficient in finding OBL than a web crawler

 

InfinityPeace

Senior Member

Jr. VIP

Jun 26, 2018

1,149

594

• Jul 18, 2018

• #8

SEO Quake is a standard add on for Fire Fox and Chrome, that will show you the total external links (OBLs) of any site page you go to.