1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

scraping videos from tube sites

Discussion in 'C, C++, C#' started by Alchemical, Nov 26, 2010.

  1. Alchemical

    Alchemical Registered Member

    Joined:
    Jun 22, 2010
    Messages:
    90
    Likes Received:
    11
    I'm looking to scrape/rip/download videos in mass from a few tube sites.

    I'm an experienced C# coder, but willing to look at any tools/techniques to get this done effectively.

    Has anyone done this, or have some ideas on the best approach? Can a regular bot do this with some additional modifications?
     
  2. darshan1994

    darshan1994 BANNED BANNED

    Joined:
    Oct 9, 2009
    Messages:
    654
    Likes Received:
    318
    Do you want to download it or just embed it to tube sites? If embed its pretty easy. Generate a embed template and replace it with video url everytime there is new video.
     
  3. Alchemical

    Alchemical Registered Member

    Joined:
    Jun 22, 2010
    Messages:
    90
    Likes Received:
    11
    I'd like to actually download the videos.
     
  4. MaDeuce

    MaDeuce Newbie

    Joined:
    Oct 24, 2008
    Messages:
    45
    Likes Received:
    16
    Location:
    Austin, TX
    I'm not a C# guy, but the approach is the same, regardless.

    For each video you want to grab, you need to find it in the relevant page and download it. As I'm partial to Python, I'd do it with a combination of Python with CURL.

    There is a .NET binding for CURL, which I am told can be used from C#. If you are going to do much of this, CURL is your friend. I can't post a link in this reply, but the main site for CURL is curl.haxx.se. Look under 'libcurl' for .NET

    If you try it out and have CURL questions, I'll be happy to help. C#, not so much.

    Good luck.