Isn't Davinci 003- Amazing?

code API

BANNED - Failed to resolve a dispute
Joined
Oct 20, 2018
Messages
6,377
Reaction score
3,514
Together with my developer, I worked my ass off a few days back, so we have just built an advanced AI copywriter on the new Davinci 003 model. I am super astonished at the quality and conversational tone of Davinci 003 model of OpenAI's GPT-3. Gave it just a few lines of prompt and yay! The output looks like magic to me right now:

Prompt: What is the love of pigeons like?
Description: Write 500 words about the love of pigeons in Ohio
Verdict: the output was a unique 400 words tho, but also with human-like quality. This means the new model must be taking 'quality over quantity' into account, somehow. Plus High level of fcking CREATIVITY.

The love of pigeons is a strong bond that many people in Ohio share. People in Ohio flock to parks and backyards to watch and feed these birds, which have become an iconic symbol of the Buckeye state. Pigeons have been around for centuries, and their presence in Ohio is a testament to their resilience.

Pigeons are found everywhere in Ohio, from the urban centers of Columbus, Cleveland, and Cincinnati to the rural villages and farms in the countryside. They live in small flocks and love to roost in the old buildings and trees along city streets. In parks, you can often find pigeons gathering in large groups to feed on seed, breadcrumbs, and other scraps.

The love of pigeons in Ohio transcends generations. Young and old alike can be seen feeding and watching the birds. The birds are often the first to greet a visitor to the park or backyard, and they will often follow a person around, waiting for a handout. Pigeons are also very social, and they can form strong bonds with people, especially those who feed them regularly.

Many Ohioans have grown to love the pigeons in their community, as they recognize the birds as a part of their local culture. This love is often expressed in art, as many artists in Ohio capture the beauty of the birds in their work. Pigeons have also been featured in music, books, and even movies, as their presence in the state has become symbolic of its spirit.

The love of pigeons in Ohio isn’t just about feeding and watching these birds. It’s also about providing a safe and healthy environment for them to thrive. People in Ohio take great care to provide the birds with clean water, safe places to roost, and plenty of food. In Columbus, a group of dedicated volunteers even provide medical care for injured or sick pigeons.

In conclusion, the love of pigeons in Ohio is a strong bond that many people in the state share. The birds provide a connection to the past, and they are a symbol of the state’s spirit. People in Ohio take great care to provide the birds with a safe and healthy environment, and they often express their love through art, music, and other forms of expression. The love of pigeons in Ohio is a testament to the state’s strong sense of community and connection to nature.
 
Last edited:
And still this OpenAI GPT2 detector caught it as fake...


5bb7d8c394d7ad7b10a39a995df3fd65.png
 
I dont know any human whose native language is english who speaks like that :)
 
And still this OpenAI GPT2 detector caught it as fake...


5bb7d8c394d7ad7b10a39a995df3fd65.png



Not all AI is able to be detected.

Here's an example from my models (open source only, doesn't use openai/gpt3)

Why do cats purr?

It is believed that purring is produced when cats have a calm, relaxed temperament, while roaring is associated with fearful or aggressive behavior.

The mystery of why cats purr has been explored for thousands of years. Cats and humans as have had a special bond for as long as 12,000 years and purring has been known to have a hypnotic, soothing effect, providing both cats and humans with a special shared experience. Purring is indicative of love, contentment, and trust, and is expressed when cats are happy, in pain, or as a way of communicating with their owners or other species.

While scientists do not fully understand why cats purr, they do know that it is made through the same organs as meowing and hissing, with frequencies between 25 and 150 Hertz. Cats and humans, joined by their shared experience of purring, continue to share a special bond of understanding and companionship.

--
Unique, passes AI detectors and is 97%+ factually correct and is pure open source.


GPT3 answering the same question :-

Cats purr as a form of communication. They may purr to show contentment and comfort, or to signal to their owners that they’re feeling safe and happy. Purring can also be used as a form of self-soothing or a way to bond with their owners.

Detected as 26% fake.

Also nowhere near 97% factually correct.
 
Not all AI is able to be detected.

Here's an example from my models (open source only, doesn't use openai/gpt3)

Why do cats purr?

It is believed that purring is produced when cats have a calm, relaxed temperament, while roaring is associated with fearful or aggressive behavior.

The mystery of why cats purr has been explored for thousands of years. Cats and humans as have had a special bond for as long as 12,000 years and purring has been known to have a hypnotic, soothing effect, providing both cats and humans with a special shared experience. Purring is indicative of love, contentment, and trust, and is expressed when cats are happy, in pain, or as a way of communicating with their owners or other species.

While scientists do not fully understand why cats purr, they do know that it is made through the same organs as meowing and hissing, with frequencies between 25 and 150 Hertz. Cats and humans, joined by their shared experience of purring, continue to share a special bond of understanding and companionship.

--
Unique, passes AI detectors and is 97%+ factually correct and is pure open source.

Cool, which open source library do u use?
Easy to install on a server and implement with WP ?
 
If Google starts using these kind of detectors (and I'm pretty sure they will), then all the articles created won't be worth anything LOL

Unlikely they will. Too much computing power required. They are limited with what they can do. Remember they're dealing with 100's of billions of pages and potentially considering trillions.

They are a business and aren't going to spend billions in computing power just to get rid of a few spammy sites, which at the end of the day have absolutely no impact on their bottom line.

Think about it..

If you were making $100 million per year, would you spend $50 million so you could make an extra $50k per year? :-)

Diminishing returns.

Cool, which open source library do u use?
Easy to install on a server and implement with WP ?

No open source machine learning library is easy to install :-) There's none you can just install on a server and use with WP.. You certainly won't be able to generate articles like the above with that.

It's not 1 model answering a question either. It's a very complex setup and I train the models on the niche, which is why it's near 100% factually correct.

It's not something I would be willing to share publicly. It's the result of cutting edge AI research and not something I want to fall into the hands of every marketer.

I combine it with my trained prompts, and the results are awesome

All the prompts in the world won't improve it. It still has access to limited information and in many cases will just hallucinate information, although much less than it used to, but this becomes more apparent when you try to create 1000's of articles with factually correct information.
 
And still this https://huggingface.co/openai-detector/ detector caught it as fake...


5bb7d8c394d7ad7b10a39a995df3fd65.png
On what algo or framework are these detectors usually built on? Someone might be able to reverse engineer it.
 
No open source machine learning library is easy to install :) There's none you can just install on a server and use with WP.. You certainly won't be able to generate articles like the above with that.

It's not 1 model answering a question either. It's a very complex setup and I train the models on the niche, which is why it's near 100% factually correct.

It's not something I would be willing to share publicly. It's the result of cutting edge AI research and not something I want to fall into the hands of every marketer.

Yes, that is obvious that you need stronger servers and additional resources for further training.
ex. BLOOM Open Source library requires at least 300GB+ disk space and min. 16GB RAM
 
Yes, that is obvious that you need stronger servers and additional resources for further training.
ex. BLOOM Open Source library requires at least 300GB+ disk space and min. 16GB RAM

16 gig of ram? :-)

Crikey.

Bloom is a 176b parameter model.

Just to RUN bloom in inference mode requires About 8 V40's

To fine tune it you need about 32 to 96. I don't even know the figures for bloom.

For opt-66b which is only 66 billion you need 32 A40's to fine tune it.

And ram you need over 300 GB.

You are looking at about $30-$35 per hour just to run bloom. $100/hr to fine tune it.

It's no joke.. But

You shouldn't be fine tuning LLMs. They're not really meant for that.

The ideal size to fine tune is 5 billion to 30 billion parameters for complex tasks. 200 million to 1 billion models for simpler tasks.
 
Not all AI is able to be detected.

Here's an example from my models (open source only, doesn't use openai/gpt3)

Why do cats purr?

It is believed that purring is produced when cats have a calm, relaxed temperament, while roaring is associated with fearful or aggressive behavior.

The mystery of why cats purr has been explored for thousands of years. Cats and humans as have had a special bond for as long as 12,000 years and purring has been known to have a hypnotic, soothing effect, providing both cats and humans with a special shared experience. Purring is indicative of love, contentment, and trust, and is expressed when cats are happy, in pain, or as a way of communicating with their owners or other species.

While scientists do not fully understand why cats purr, they do know that it is made through the same organs as meowing and hissing, with frequencies between 25 and 150 Hertz. Cats and humans, joined by their shared experience of purring, continue to share a special bond of understanding and companionship.

--
Unique, passes AI detectors and is 97%+ factually correct and is pure open source.


GPT3 answering the same question :-

Cats purr as a form of communication. They may purr to show contentment and comfort, or to signal to their owners that they’re feeling safe and happy. Purring can also be used as a form of self-soothing or a way to bond with their owners.

Detected as 26% fake.

Also nowhere near 97% factually correct.
But you still need one of the NLP models...
 
To run BLOOM int8 you need 8x 3090. Not the best but manageable.
 
Which model would you suggest?

It's much more than a single model you need I'm afraid. It's not an easy thing to create a content creation app. I've been developing one with my team for months now.
 
It's much more than a single model you need I'm afraid. It's not an easy thing to create a content creation app. I've been developing one with my team for months now.
I was asking because we working on similar software. Currently experimenting with GPT-Neo 2.7B, OPT, and BLOOM. All fine-tuned. The output is good but we are not there yet.
We realized that the BLOOM is a pain in the ass. It's veryyyy expensive to run it and quite slow.
 
Back
Top