1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Content Distribution Through Decentralization

Discussion in 'BHW Beta Testers' started by The Doctor, Jul 19, 2015.

Thread Status:
Not open for further replies.
  1. The Doctor

    The Doctor Jr. VIP Jr. VIP

    Joined:
    Dec 18, 2010
    Messages:
    955
    Likes Received:
    295
    Occupation:
    Computer Scientist, Engineer, Programmer.
    Location:
    ☆☆☆☆☆☆
    Home Page:
    Since I see that you're moving away from Akamai, it seems like a good idea to have a thread here to suggest a better way of doing CDN. I'd mentioned it before in a suggestion thread but not for the new site. A forum with so many users is constantly serving the same content. Almost all content being served is always being viewed and downloaded at the same time. Even a user sitting on a thread page from a year ago is still using the same content as everyone else to construct the page, save some text. It's very easy (Requiring the inclusion of some javascript) for users to serve each-other common content using WebRTC via javascript and a signaling server. Such CDNs run signaling servers, allowing you to use them for free and have your users distributing content to each-other just by making a 1 line javascript include. This is transparent to the user and would require no altering of any server-side or client-side code except adding the client-side include line.

    Even if you're using a traditional CDN, doing this takes more of the burden off of your servers and the CDN by making use of the WebRTC data channel. In such a high traffic forum, drastic amounts of bandwidth would be saved as each user helps serve up another as they visit. I have a signaling server running STUN/TURN right now for similar purposes. The signaling is very low bandwidth as it just coordinates connections. You can even run a signaling server in the browser itself. There are javascript libraries you can use to roll your own solutions if you really want but you don't have to.

    A quick Google search for "webrtc cdn" will turn up many startups that offer free and cheap plans where you only have to add a line of code to your site which in turn can reduce your bandwidth by over 90%, especially on a high traffic site such as BHW where there's always going to be high availability. Even the paid plans are cheap because it costs them nothing since they don't actually distribute your content. PeerCDN was great and Yahoo bought them. There's also Swarmify and others.

    Another reason why I always suggest doing this is because that's where the Internet is headed, decentralization wherever possible. It's just taken a long time to get the browser support for it that we finally have now.
     
  2. Diamond Damien

    Diamond Damien Owner BlackHatWorld Staff Member Jr. VIP

    Joined:
    Oct 27, 2005
    Messages:
    55,738
    Likes Received:
    13,089
    Occupation:
    BlackHatWorld
    Location:
    BHW - of course.
    Home Page:
    Many thanks to all Jr. VIP beta testers - this release is now closed. Full beta going live soon acknowledging feedback that has been provided here.
     
Thread Status:
Not open for further replies.