scraping music mp3 URL

[shaymiller]

I am using a scraper plugin in wordpress to scrape a music website. I can't view its mp3 rl directly from source code, because they use javascript/php to play those files. I can see song id # in the source code.

I'm wondering how do I find its actuall music URL, so that when I scraper the URL it plays music off my site and don't redirect to that size. The the url of that site is music.com/SONG_NAME

I can PM the actual URL if anyone is interested, don't want to spam here

 

[shaymiller]

^bump

 

[Bot Inspector]

The best way is to use scarper which executes javascript.

 

[shaymiller]

The best way is to use scarper which executes javascript.

Thanks,
Can you recommend one? And even if do get one, what are the techniques or process to find those URLs

 

[Deleted member 657006]

it can be done but it illegal and they wont sell as downloads your get nicked


it illegal copyright .

is that your intentions?

you can use torrents and get them all do what you want then.

but it illegal.

you can get a off sure sever but it illegal work and not knowing what your doing can get you nicked only warning

 

[Deleted member 657006]

any music and movies got the best solicitors to sue under copywrite act be very carefull and warned .

they usally follow the money or even employ hackers to see any footprints to nick you directly.

i have known ppl that have been sued so heigh playing 1 tune on there website they lost there home on court fees , fact ....

they go for anythink money or prison you got ....

a lot of ppl full into this trap untill there door being kicked in early hours morning .

and yes it happends

i heard so bad storys becouse they arrest anybody in the home, push them to the floor handcuff them .

not good complete showup

 

[X-R0]

@shaymiller I hope you just testing your scraping skills... it's 2018, get yourself a spotify Account

 

[Bot Inspector]

Thanks,
Can you recommend one? And even if do get one, what are the techniques or process to find those URLs

It's not easy to integrate such parser in WP plugin. You need to create an API for a standalone headless/remote browser which will receive URL, makes parsing and return results.
My advice: hire a coder for that.

 

[milk_and_cake]

I am using a scraper plugin in wordpress to scrape a music website. I can't view its mp3 rl directly from source code, because they use javascript/php to play those files. I can see song id # in the source code.

I'm wondering how do I find its actuall music URL, so that when I scraper the URL it plays music off my site and don't redirect to that size. The the url of that site is music.com/SONG_NAME

I can PM the actual URL if anyone is interested, don't want to spam here

Im interested in taking a look. I like building my own scrapers so challenge is always fun.

PS: IM NOT TRYING TO SELL MY SERVICES, JUST HELPING OUT!

 

[shaymiller]

Thanks everyone of their opinion. Few of folks PM about it too, so I appreciate the help. (still unresolved)

it can be done but it illegal and they wont sell as downloads your get nicked


it illegal copyright .

is that your intentions?

you can use torrents and get them all do what you want then.

but it illegal.

you can get a off sure sever but it illegal work and not knowing what your doing can get you nicked only warning

Not trying to do anything illegal here by sharing. just improving my skills. Not trying to downloading anything either. Will still want to stream off their server URL

@shaymiller I hope you just testing your scraping skills... it's 2018, get yourself a spotify Account

Well said!!!

It's not easy to integrate such parser in WP plugin. You need to create an API for a standalone headless/remote browser which will receive URL, makes parsing and return results.
My advice: hire a coder for that.

I actually prefer standalone. I picked WP because I couldn't find standalone. WP plugin is user-friendly.

Im interested in taking a look. I like building my own scrapers so challenge is always fun.

PS: IM NOT TRYING TO SELL MY SERVICES, JUST HELPING OUT!

me too. I like to challenge myself. Just trying to improve skills. I tried RSS feed, but they can't scrape as what I need.

 

[Aty]

@shaymiller I hope you just testing your scraping skills... it's 2018, get yourself a spotify Account

Spotify ain't available is many countries.

 

[shaymiller]

I can play any song on that website but to download, they require subscription. But when I type the web URL into https://www.online-convert.com/ it downloads it mp3. So that’s why I was thinking there is a hidden mp3 file I can mass download. I’m not trying to download one song but learn how to mass scrape those files. I can get the URL of song page, but mp3 file isn’t easily visible in chrome developer inspector.

Few ppl IM me to help, but weren’t successful, now I feel I want to challenge this

 

[infludump]

You can use a 'headless' browser as a scrapper, it will execute javascript and act just like a browser. There are many libraries in many different languages to do this, just google it or search for it on github.

 

[shaymiller]

@infludump thanks for suggestion. I'm a newbie at scraping. I only know much php, little bit .js. I searched for headless browser, I got python language libraries. can you please suggest few videos/tutorial to read more on this? you can even paste google search keywords

thanks

 

[The Undefined]

Hey there @shaymiller,
For the quick answer, you have to use Selenium (or other alternatives which I don't know) then create a basic JS script to capture the music source.
If your target website uses javascript to fetch some sort of mp3 URLs into the dom you're good to go with selenium and one of its official language wrappers; otherwise, You have to set up an HTTP monitoring for a browser to see what's going on under the hood.
For example, If you're going to copy songs from Spotify you have to take a note that They do defensive programming, so There are no MP3 files which you can download directly, but there are multiple keep-alive requests fetching your song part by part and you have to deal with it and the authentication part.

 

[davids355]

Thread moved to general programming forum.

Just a reminder to everyone this is open for discussion only.

@shaymiller If you have not found help within this thread it may be a better bet posting in hire a freelancer and I am sure someone will be able to get the job done for you there.