1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Is This Possible? Or Even Legal?

Discussion in 'BlackHat Lounge' started by SpellZ, Aug 19, 2012.

  1. SpellZ

    SpellZ Regular Member

    Joined:
    Feb 8, 2009
    Messages:
    357
    Likes Received:
    312
    Location:
    Toronto, ON
    So I have about 9 different blogs in the same niche that I follow. Actually, scratch that. I have 6 blogs that I follow, and 3 YouTube Channels. My question is, can I create a website where whenever they post something on their blog/youtube-channel, my site will scrape that somehow and put it on my site, all nice and all? Of course, giving credit to the original blob/video.

    Millions thanks!
     
  2. Xp3r7

    Xp3r7 Regular Member

    Joined:
    Sep 9, 2011
    Messages:
    286
    Likes Received:
    386
    Occupation:
    Freelancer
    Location:
    In the middle of nowhere
    Sure you can.
    A PHP script + cronjobs(to check for new content)?
     
  3. hendort

    hendort Junior Member

    Joined:
    Nov 16, 2010
    Messages:
    127
    Likes Received:
    99
    Occupation:
    student
    Im not sure about auto scraping youtube, but you can use a blogs rss feed. Sounds like you're looking to make an autoblog?
     
  4. SpellZ

    SpellZ Regular Member

    Joined:
    Feb 8, 2009
    Messages:
    357
    Likes Received:
    312
    Location:
    Toronto, ON
    Is that what you call an autoblog? Are those legal?

    Also, how will Google react? Since I will be copy/pasting the content from one site, to my site? Of course, with the source where it was taken from, but nonetheless, copied content.
     
  5. tristangemus

    tristangemus Regular Member

    Joined:
    Feb 10, 2009
    Messages:
    256
    Likes Received:
    97
    Location:
    Canada
    Home Page:
    Install Wordpress and get an auto poster plugin. It uses their RSS feed to automatically post to your blog.
     
  6. beaglejuice

    beaglejuice Power Member

    Joined:
    Mar 12, 2009
    Messages:
    595
    Likes Received:
    423
    Yes it's possible. Legal, don't know yet given the limited facts. But if you think google is that dumb to not catching you, then you're absolutely wrong.
     
  7. SpellZ

    SpellZ Regular Member

    Joined:
    Feb 8, 2009
    Messages:
    357
    Likes Received:
    312
    Location:
    Toronto, ON
    Noooo, the whole reason behind it is that I want to stay as white hat as possible, and as legal as possible. I just don't want to go to like 9 different sites (and I'm sure other people dont want to as well). So it'll sorta be like a 'hub' of all the sites combined into one...

    While giving the proper credits to the sites
     
  8. Will759

    Will759 Newbie

    Joined:
    Apr 20, 2012
    Messages:
    11
    Likes Received:
    7
    It is legal AFAIK if you give credit (since all the big blogs /do/ it to each other). a simple PHP script would do it fine. and run a crontab to execute the command line of that script every so often.
     
  9. dubious

    dubious Regular Member

    Joined:
    Apr 22, 2012
    Messages:
    235
    Likes Received:
    222
    Occupation:
    Project Manager/Business Development Manager
    Location:
    Australia
    How to get a YouTube RSS feed:

    • https://gdata.youtube.com/feeds/api/videos?orderby=updated&vq=SEARCHQUERY
    ^ feed by Search Query
    • https://gdata.youtube.com/feeds/api/users/USERNAME/uploads?orderby=updated
    ^ feed by User Name
    • https://gdata.youtube.com/feeds/api/playlists/PLAYLISTID
    ^ feeds by Playlist. Note, remove the PL from playlist, id is the raw numbers (YT is horrible at consistancy and this convention changes all the f-ing time)

    You can convert these feeds into auto blog, aggregate feeds to create an interesting on or simple to have an interesting mode on a website.