1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Data Scrap a website (complex Data Retrieval) [$100]

Discussion in 'Hire a Freelancer' started by rus1239, Apr 8, 2013.

  1. rus1239

    rus1239 Newbie

    Joined:
    Oct 29, 2011
    Messages:
    18
    Likes Received:
    0
    I require someone with Data Scrapping experience to create a software or show me a method that I can use to data scrap a tv show website.

    Here is the process in simplified terms:

    1. I am trying to collect the direct video links to TV episodes. The website I am trying to get them from is btvguide.com. The problem is that the website requires that a "form" be submitted before it reveals the direct link to the TV episode. Here is an example:
    btvguide.com/Game-of-Thrones/Season-2/episode-10/watch-online

    In the link above, the episode results list shows links to episodes like movpod.in and gorillavid.in. I am trying to get the direct links of these websites. The problem is, you need to click on "External Link" and then "Visit the Website" before the server of the website will send you to the link. It is not possible to retrieve the link from the server without doing these 2 actions which I described.

    Basically I am trying to retrieve any direct link in the results page except links which were added by the crawler (as these links are poor quality). So from btvguide.com/Game-of-Thrones/Season-2/episode-10/watch-online I am only trying to get the first 7 links ( from the links added by cleo to the links added by Monica). I need the software to ignore the links added by the crawler.

    I would need the software to produce for me an Excel file with the output of the data it mines seperated into 2 columns. I am looking for the following: Episode Title (For example game of thrones Season 2 Episode 10 "Free Honey" ) and Link URL to the external site (for example movpod.in/e93jtysgvt85 (obtained from the second link in the results page) ). The episode title goes in one column, the link goes into another.

    My budget for this project is $60. Additionally if you can make a data scrapping software for a similar site, I will pay $40 for it.
    Here is the other site:
    tvmuse.eu/tv-shows/Daria_197/season_5/episode_4/video-results/

    Scrapping data from this site is extremely similar to the first one, so it should be easy once you figure out how to do it for the first site.

    Just to recap:
    Data mine software for btvguide. com : $60
    Data mine software for tvmuse.eu : $40
     
  2. handmadebots

    handmadebots Senior Member

    Joined:
    Nov 8, 2012
    Messages:
    902
    Likes Received:
    204
    Home Page:
    Sent you a PM buddy.
     
  3. awsomnick1

    awsomnick1 BANNED BANNED

    Joined:
    Feb 8, 2010
    Messages:
    539
    Likes Received:
    154
    I can do this.
     
  4. blackhat777

    blackhat777 Elite Member

    Joined:
    Jun 25, 2011
    Messages:
    1,779
    Likes Received:
    653
    Pm me your skype..
     
  5. rus1239

    rus1239 Newbie

    Joined:
    Oct 29, 2011
    Messages:
    18
    Likes Received:
    0
    Already hired someone, disregard this thread.
     
  6. blogbd1

    blogbd1 Jr. VIP Jr. VIP Premium Member

    Joined:
    Apr 19, 2008
    Messages:
    551
    Likes Received:
    353
    Location:
    Undetected
    Hi, do you need to scrape the whole website? Or you will input a link and the software will scrape links for that page?

    There are multiple video links for a single episode, do you want to scrape all links or just the first one?

    Thanks