1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

YouTube URL Scraper?

Discussion in 'YouTube' started by lukywest1, Oct 26, 2015.

  1. lukywest1

    lukywest1 Junior Member

    Joined:
    Nov 21, 2011
    Messages:
    161
    Likes Received:
    5
    I need a tool that will extract or scrape YouTube video URLs in the past 24-48 hours based on the keyword I set. At the moment I'm doing it manually as I did not find any software yet. I'm able to produce a list of 3,000 links a day manually. Any bot that might help me with this? please let me know.
     
  2. fatboy

    fatboy Elite Member

    Joined:
    Aug 13, 2008
    Messages:
    1,618
    Likes Received:
    3,229
    Occupation:
    Retired
    Location:
    Old Peoples Home
    Looking at the available filters the 24 hour thing should be easy to do, 48 hours not so easy :)
     
  3. fatboy

    fatboy Elite Member

    Joined:
    Aug 13, 2008
    Messages:
    1,618
    Likes Received:
    3,229
    Occupation:
    Retired
    Location:
    Old Peoples Home
    I gotta run for a bit but here is a quick dirty bot that will take a number of keywords and then scrape videos using the 'today' filter so I guess thats 24 hours.

    Gave it a quick test and it seemed to run okay - at the end it will save a text file of links on your desktop in KEYWORD.txt format.

    Hope it helps.

    Code:
    Download: http://www.mediafire.com/download/k2r1a2juwm6cf42/Video_Scrape.exe
    VT (0/55): https://www.virustotal.com/en/file/aa9f7fc326ee9af816434a950b52c678c1e7cc5780f287f440cff5c78570ef3a/analysis/1445888718/
    
     
    • Thanks Thanks x 1
  4. lukywest1

    lukywest1 Junior Member

    Joined:
    Nov 21, 2011
    Messages:
    161
    Likes Received:
    5
    It's not working :( this is the error I get

    T9OkYea.png
     
  5. lukywest1

    lukywest1 Junior Member

    Joined:
    Nov 21, 2011
    Messages:
    161
    Likes Received:
    5
    It takes a while to load but it works! Thank you for sharing. Now I don't need to collect links manually :) You're the boss :shakehand
     
    Last edited: Oct 27, 2015
  6. h_10070782

    h_10070782 Regular Member

    Joined:
    Sep 29, 2009
    Messages:
    217
    Likes Received:
    27
    3000 links ? with youtube search you cant do that , but google does , and use crapebox or something like that are good to go .or just like AutomateIt say
     
    • Thanks Thanks x 1
  7. Plus44

    Plus44 Power Member

    Joined:
    Dec 14, 2014
    Messages:
    644
    Likes Received:
    245
    Gender:
    Male
    Location:
    US
    Have you tried TubeToolbox? 48 hour free trail
     
    • Thanks Thanks x 1
  8. lukywest1

    lukywest1 Junior Member

    Joined:
    Nov 21, 2011
    Messages:
    161
    Likes Received:
    5
    I will download the free lite version and thank you for sharing.
     
  9. lukywest1

    lukywest1 Junior Member

    Joined:
    Nov 21, 2011
    Messages:
    161
    Likes Received:
    5
    Yes 3,000 links manually with different keywords and I might try to use scrapebox, they also have the option to scrape links from YouTube.
     
  10. lukywest1

    lukywest1 Junior Member

    Joined:
    Nov 21, 2011
    Messages:
    161
    Likes Received:
    5
    Nope haven't tried yet but will give it a go :) thanks for sharing.
     
  11. Plus44

    Plus44 Power Member

    Joined:
    Dec 14, 2014
    Messages:
    644
    Likes Received:
    245
    Gender:
    Male
    Location:
    US
    It had the option to scrape videos based on new uploads for you to use within the program, but I never tried to see if they could be saved in a text document or spreadsheet. I'd let you know for sure, but can't now since my trial ran out
     
  12. ZennoScripts

    ZennoScripts Junior Member

    Joined:
    Aug 21, 2015
    Messages:
    172
    Likes Received:
    61
    Location:
    USA
    If anyone else is looking for an advanced YouTube video scraper hit me up. I have an extremely advanced bot that can sort out junk/bad videos for you based on a set of filters.
     
  13. onlythabst

    onlythabst Jr. VIP Jr. VIP Premium Member

    Joined:
    Dec 28, 2010
    Messages:
    676
    Likes Received:
    90
    I'm looking for a scraper that will only pull videos if there is no "Do You Believe" by Poolside (Google Play ? iTunes ? eMusic ? AmazonMP3)" at the bottom. So PM me if you have this.
     
  14. Plus44

    Plus44 Power Member

    Joined:
    Dec 14, 2014
    Messages:
    644
    Likes Received:
    245
    Gender:
    Male
    Location:
    US
    I forget what the program name was exactly, but it was free. I'll see if I can find it for you.


    The method I used:
    Change your default # of results per page from 10 to 100 in your Google search settings.

    Then do a Google video search for the videos you'd like to target using " " to exclude the words you do not want and then use the search tools to filter them to a specific time range. So in your case you'd want to search for this in the example you gave Do You Believe "(Google Play • eMusic • AmazonMP3 • iTunes)"

    Then I would drag and drop just the search url from my address bar to into the video downloader and it would queue up 100 videos.... But instead of clicking start to download the videos, I was able to just drag the queued video list into a blank text document and keep just the links

    It was manual work but it didn't take long at all. I was scraping thousands of videos in like 5 mins no problem

    But for the life of me though I can't seem to remember the name of that downloader. I will try to find it
     
  15. Sweetfunny

    Sweetfunny Jr. VIP Jr. VIP

    Joined:
    Jul 13, 2008
    Messages:
    1,785
    Likes Received:
    5,067
    Location:
    ScrapeBox v2.0
    Home Page:
    If you want to only scrape YouTube video's in the last 24 hours in ScrapeBox, just go to Settings > Harvester Engines Configuration, and select the YouTube engine. Then on the end of the URL add:

    And click update, this will make it harvest video's uploaded in the last 24 hours instead of anytime.

    [​IMG]

    Then after you harvest the URL's, you can go to Grab/Check > Grab YouTube video's from harvested urls. Here you can download the videos, download soundtracks, get the view count, likes, dislikes filter by keywords or author etc.

    [​IMG]

    More info here http://www.scrapebox.com/youtube-downloader