Yandex just open sourced a 100B - GPT Like Model

BlogPro

Jr Vip
Jr. VIP
Joined
Apr 23, 2012
Messages
1,656
Reaction score
2,530
Website
wordsigma.com
YaLM 100B is a GPT-like neural network for generating and processing text. It can be used freely by developers and researchers from all over the world.

The model leverages 100 billion parameters. It took 65 days to train the model on a cluster of 800 A100 graphics cards and 1.7 TB of online texts, books, and countless other sources in both English and Russian.


Calling all my AI / ML boys to the yard.

@Sartre @Cognitive @spectrejoe @Alma @mdevo @NulledCode @ghengis_khan

That GPU req tho!
 

Cognitive

Jr. VIP
Jr. VIP
Joined
Mar 11, 2015
Messages
302
Reaction score
163
Wow. Cool.
With BigScience 176B that should be available soon, I think it's going to be a hot summer in the AI community :D

 

Cognitive

Jr. VIP
Jr. VIP
Joined
Mar 11, 2015
Messages
302
Reaction score
163
There will be an AI technology where they'll fit a bot in your throat and it will do the talking, making your conversation smooth and without any errors. :p
We're already there, although no bot in the throat for the moment. But a chip in the brain :D


"Six out of 10 Americans would consider having a computer chip surgically implanted into their brains if they could turn the technology off or on."
Source:
 

Panther28

Jr. Executive VIP
Jr. VIP
Joined
May 2, 2010
Messages
5,673
Reaction score
8,333
An English and Russian lovechild Ai, hmmm :D

At least it will be able to write you an article on the chess game skills of the Kardashians. lol
 

BlogPro

Jr Vip
Jr. VIP
Joined
Apr 23, 2012
Messages
1,656
Reaction score
2,530
Website
wordsigma.com
Are there any bitcoin miners looking to get rig of some mining rigs? I could use some more GPU.

Same. And I'll pay you what he's paying + give you a massage. I have really soft hands.
 

MuayThai

Jr. VIP
Jr. VIP
Joined
Aug 25, 2015
Messages
1,699
Reaction score
591
Website
cyber-gateway.net
Content writers are going to be out of job in a couple of years.
I doubt that. Most probably, in the couple of years we will see the real separation of content writers and re-writers.
And then re-writers will be out of job, at last and for good.
 

Ashk881

Regular Member
Joined
Aug 24, 2021
Messages
462
Reaction score
493
Surprisingly doesn't take a NASA supercomputer to self host.

You can run this on a p3dn.24xlarge instance at AWS. That thing costs like $30/hr

Only if I weren't broke to play around with this :)
 

MisterF

Jr. Executive VIP
Jr. VIP
Joined
Nov 29, 2009
Messages
26,226
Reaction score
39,488
Website
www.blackhatworld.com
Those who say something like that are just "the world is gonna end in 2012" type of people of IM.

SEO is Dead and has been since 2012, type of people.
 
Top