Tools to extract url's

M

Mr_X

Newbie

Nov 7, 2016

18

1

• Nov 7, 2016

• #1

Does anyone know of any tools to extract URL (media url's) from websites?

Basically I want to extract the stream links from my favorite streaming website, or if there is an easier method for getting mass stream links what would you suggest?

 

DunDidIt2X

Elite Member

Mar 22, 2012

2,864

2,430

• Nov 7, 2016

• #2

If it is sound cloud, you might want to check out booster bots. They have a sound cloud bot.

 

samcram

Junior Member

Sep 10, 2014

199

64

• Nov 7, 2016

• #3

Screaming Frog can do it, maybe some other crawler..

 

mbreezy

Power Member

Jun 27, 2012

527

178

• Nov 7, 2016

• #4

Screaming Frog or Xenu will most likely get the job done.

Maybe URL Profiler or Scrapebox?

 

M

Mr_X

Newbie

Nov 7, 2016

18

1

• Nov 7, 2016

• #5

Thank you for the suggestions, I will look them up.

 

M

Mr_X

Newbie

Nov 7, 2016

18

1

• Nov 7, 2016

• #6

EDIT: I found some information from Xenu that the site is using json files I assume for the embedding videos to load quicker?

If anyone has information to help me understand, it is appreciated.

 

Last edited: Nov 7, 2016