crackedcreative
Junior Member
- Jul 19, 2012
- 143
- 71
What are some methods you've found in "breaking" chat gpt?
A report shows you could extract training data from ChatGPT by asking it to repeat the word "poem" forever... it eventually ends with pasting some of its training data.
I've tried this and it has already been patched. So don't bother.
Here's an article that discusses it:
https://techxplore.com/news/2023-12-prompts-chatgpt-leak-private.html
original paper from cornell university:
https://arxiv.org/abs/2311.17035
Any other ways you've discovered jailbreaks for ChatGPT?
Or for Claude.ai?
A report shows you could extract training data from ChatGPT by asking it to repeat the word "poem" forever... it eventually ends with pasting some of its training data.
I've tried this and it has already been patched. So don't bother.
Here's an article that discusses it:
https://techxplore.com/news/2023-12-prompts-chatgpt-leak-private.html
original paper from cornell university:
https://arxiv.org/abs/2311.17035
Any other ways you've discovered jailbreaks for ChatGPT?
Or for Claude.ai?