Tools to automate this?

AgentZero

Regular Member

Jul 10, 2008

446

88

• Aug 26, 2015

• #1

Hi basically i have a large list of page URLs and want to gather the external links for each URL at once.

Currently we have been manually doing this e.g. inserting the URL into ahref, exporting the links, then putting all the links together in one single excel file. Which can take a while.

Any solutions i should check out to automate this?

AZ

 

D

Deleted member 209614

Guest

• Aug 26, 2015

• #2

i think you need custom bot for this

 

bigkapp

Regular Member

Dec 8, 2010

461

404

• Aug 27, 2015

• #3

Scrapebox has a add-on that dose this. Also look into the automation plugin too scrape each URL individually.

 

mindmaster

Elite Member

Sep 16, 2010

5,671

3,112

• Aug 27, 2015

• #4

No need for custom bots.

Scrapebox addon Link Extractor will do the job faster than you can take a shit.

 

AgentZero

Regular Member

Jul 10, 2008

446

88

• Aug 28, 2015
• Thread Starter Thread Starter

• #5

I think there is a misunderstanding, i'm referring to external links pointing to the page not external links pointing from a page.

Scrapebox can't do that, it doesn't use a majestic, ahrefs, from my knowledge.

 

Last edited: Aug 28, 2015

mindmaster

Elite Member

Sep 16, 2010

5,671

3,112

• Aug 28, 2015

• #6

So you want to identify the backlinks.
For first 1000 backlinks for each url you can use Scrapebox Backlink Checker (http://www.scrapebox.com/mass-backlink-checker)
It uses moz api.

 

AgentZero

Regular Member

Jul 10, 2008

446

88

• Aug 31, 2015
• Thread Starter Thread Starter

• #7

Thanks mindmaster,

That is exactly what i want. Moz database isn't great, so i'm going to get a custom script created.