I require someone with Data Scrapping experience to create a software or show me a method that I can use to data scrap a tv show website.
Here is the process in simplified terms:
1. I am trying to collect the direct video links to TV episodes. The website I am trying to get them from is btvguide.com. The problem is that the website requires that a "form" be submitted before it reveals the direct link to the TV episode. Here is an example:
btvguide.com/Game-of-Thrones/Season-2/episode-10/watch-online
In the link above, the episode results list shows links to episodes like movpod.in and gorillavid.in. I am trying to get the direct links of these websites. The problem is, you need to click on "External Link" and then "Visit the Website" before the server of the website will send you to the link. It is not possible to retrieve the link from the server without doing these 2 actions which I described.
Basically I am trying to retrieve any direct link in the results page except links which were added by the crawler (as these links are poor quality). So from btvguide.com/Game-of-Thrones/Season-2/episode-10/watch-online I am only trying to get the first 7 links ( from the links added by cleo to the links added by Monica). I need the software to ignore the links added by the crawler.
I would need the software to produce for me an Excel file with the output of the data it mines seperated into 2 columns. I am looking for the following: Episode Title (For example game of thrones Season 2 Episode 10 "Free Honey" ) and Link URL to the external site (for example movpod.in/e93jtysgvt85 (obtained from the second link in the results page) ). The episode title goes in one column, the link goes into another.
My budget for this project is $60. Additionally if you can make a data scrapping software for a similar site, I will pay $40 for it.
Here is the other site:
tvmuse.eu/tv-shows/Daria_197/season_5/episode_4/video-results/
Scrapping data from this site is extremely similar to the first one, so it should be easy once you figure out how to do it for the first site.
Just to recap:
Data mine software for btvguide. com : $60
Data mine software for tvmuse.eu : $40
Here is the process in simplified terms:
1. I am trying to collect the direct video links to TV episodes. The website I am trying to get them from is btvguide.com. The problem is that the website requires that a "form" be submitted before it reveals the direct link to the TV episode. Here is an example:
btvguide.com/Game-of-Thrones/Season-2/episode-10/watch-online
In the link above, the episode results list shows links to episodes like movpod.in and gorillavid.in. I am trying to get the direct links of these websites. The problem is, you need to click on "External Link" and then "Visit the Website" before the server of the website will send you to the link. It is not possible to retrieve the link from the server without doing these 2 actions which I described.
Basically I am trying to retrieve any direct link in the results page except links which were added by the crawler (as these links are poor quality). So from btvguide.com/Game-of-Thrones/Season-2/episode-10/watch-online I am only trying to get the first 7 links ( from the links added by cleo to the links added by Monica). I need the software to ignore the links added by the crawler.
I would need the software to produce for me an Excel file with the output of the data it mines seperated into 2 columns. I am looking for the following: Episode Title (For example game of thrones Season 2 Episode 10 "Free Honey" ) and Link URL to the external site (for example movpod.in/e93jtysgvt85 (obtained from the second link in the results page) ). The episode title goes in one column, the link goes into another.
My budget for this project is $60. Additionally if you can make a data scrapping software for a similar site, I will pay $40 for it.
Here is the other site:
tvmuse.eu/tv-shows/Daria_197/season_5/episode_4/video-results/
Scrapping data from this site is extremely similar to the first one, so it should be easy once you figure out how to do it for the first site.
Just to recap:
Data mine software for btvguide. com : $60
Data mine software for tvmuse.eu : $40
