1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Check if videos still exist

Discussion in 'General Scripting Chat' started by Dove1992, Oct 11, 2014.

  1. Dove1992

    Dove1992 Newbie

    Joined:
    Apr 19, 2014
    Messages:
    21
    Likes Received:
    1
    Hey guys,

    I have a couple of links to different porn tube sites like redtube, youporn, tnaflix etc... (around 10.000 links).

    Is there a way to check all of them and to find out which videos were deleted?

    Maybe a script could help or you know a nice website which offers this service.

    I would appreciate if you have a solution for this problem :)

    Regards.
     
  2. TrafficWizard

    TrafficWizard Junior Member

    Joined:
    Aug 22, 2014
    Messages:
    160
    Likes Received:
    26
    Well we can get a simple response in html and compare it.. if it's "not found", "missing" then link is removed from text file(as example) if it's ok and response is longer than in missing case link is ok !

    a simple python script should get done all in 40min's~ depends on connection/websites etc if you need help with script post here or pm as i don't track posts
     
  3. saadad

    saadad Junior Member

    Joined:
    Feb 25, 2009
    Messages:
    168
    Likes Received:
    22
    Home Page:
    Or you can do it with bot, who will navigate and check.
     
  4. macdonjo3

    macdonjo3 Jr. VIP Jr. VIP Premium Member

    Joined:
    Nov 8, 2009
    Messages:
    5,560
    Likes Received:
    4,317
    Location:
    Toronto
    Home Page:
    That's what he was talking about...

    I'd read the source for keywords like "Not found" if the page doesn't return a 404.
     
  5. bytzu

    bytzu Registered Member

    Joined:
    Jun 30, 2011
    Messages:
    96
    Likes Received:
    137
    • Thanks Thanks x 1
  6. TrafficWizard

    TrafficWizard Junior Member

    Joined:
    Aug 22, 2014
    Messages:
    160
    Likes Received:
    26
    Dove1992 here you go - as for others maybe come handy some times... : )

    download: http://files.fm/u/snjoofm

    folder contains 3 files
    good_links.txt <- emty file where good links will be extracted
    bad_links.txt <- where all links are listed.. (must be with prefix "http://")
    linkcheck.py <- python file - does the magic ;)

    HOW to setup:

    Download: Python 2.7 <- google for it

    Download: Mechanize for python (https://pypi.python.org/packages/so....2.5.zip#md5=a497ad4e875f7506ffcf8ad3ada4c2fc)

    (hint* to install mechanize on NT machines do following: open up CMD. type "cd Desktop" press enter type"cd mechfoldername" press enter type "setup.py install" press enter.. it will install mechn. to python directory on C drive ;)

    Now all should work just paste all links in bad_links.txt file and run python file it should extract good ones tested on redtube works good..
     
    • Thanks Thanks x 1
  7. Dove1992

    Dove1992 Newbie

    Joined:
    Apr 19, 2014
    Messages:
    21
    Likes Received:
    1
    Thank you guys very much! I don't have the time at the moment to test everything but I'm sure it will work great.