A new AI journey! (content automation)

Talyn

Regular Member
Joined
Oct 22, 2014
Messages
216
Reaction score
74
Hey all,

After making good money with fiction books on KDP for years, it's time for me to embark on a new journey. I got tired of dealing with ghostwriters and the fact that the life cycle of non-fiction books is getting shorter and shorter.

I have no proper CS education, even if I have a few agile certs, but learned "on the field" for years, I'm not even halfway decent in coding, but I'm still learning every day.

At the beginning of this year, I started playing with Chat GPT, which was getting a lot of hype. Since I can code a bit in Python, I started playing around with the unofficial API at that time and then moved on to the official Davinci and recently the GPT3.5 API.

As of today, I have created three sites:

  1. The first website:
    I used the official Davinci-003 API and unofficial/wrapper ChatGPT (which was a pain in the ass to deal with because of incomplete answers). The algorithm was really basic, just a list of keywords and ideas to use for each keyword in a CSV file. The niche is kind of related to finance and it's not getting a lot of traffic (and the search volume in google keywords is non existent).

  2. The second website focuses on as few uncommon niches:
    It's a pure PAA website, with 700-800 words articles. I switched to the GPT-3.5 turbo and I introduced new few functionalities, like pushing articles to WordPress automatically, basic article outlining process (pictures, videos, etc.)
    So far, the website has 5k pages indexed and is getting some decent traffic.
    This website also pushed me to work on a solution for indexing pages faster. I implemented the functionality to send the URL to GSC with the Google API, and so far, it works well.

  3. The third site is a PAA/education site in a not too narrow niche.
    This time I focused on my PAA scrapper, which feeds a an input CSV and then creates engaging but basic outlines before prompting/generating articles. It was a great introduction to Re3 and how to deal with numerous prompts to generate a consistent article (without getting millions of introductions/conclusions in the same article). This website is getting decent traffic with 600 articles ranging from 1500 to 12000 words long. For now, I don't plan to generate more articles as I hit a wall with content generation and am struggling to get a good algorithm for Re3. I'm still not happy with my outputs, and I'd like to have GPT3.5 generate more "storytelling" articles. I'm actively working on it.
    The whole site got generate within 72h and got indexed within 48h so my way to push the articles to google seems to be working
  1. The fourth website is in a highly competitive niche, but with readers who have a tendency to binge shop.
    In order to rank better, I'm focusing on keyword volume and interlinking. Here's what I'm working on:
  • How to validate keywords (cosine analysis)
  • Clustering keywords (maybe K-Means? DBSCAN? Hierarchical clustering? with or without using embeddings?)
  • Interlinking (cosine and embeddings?)
  • How to write titles on thumbnails + quality control (pillow)
  • Code architecture, even if I commented it, it's a mess, and as I added more functionalities, I don't want to turn it into something impossible to maintain.
What I'm working on in the long haul:
  • Improving the content quality with Re3. I'm considering hiring a tutor/teacher to learn faster.
  • Improving quality control before pushing the articles.
  • Streamlining to be able to feed a few keypoints/data and let it run alone with some gate controls.
  • SQL: several CSVs with several thousand lines is a pain to deal with
  • Performance analysis. So far, I track the time it took for each article and the word count.
  • UI, command line is cool, but not fun, I'd like to have a nice dashboard.
  • Multithreading with concurrent.futures / ThreadPoolExecutor as the bottleneck is the API and not the processing power if I don't use any NLP/LLM in local like alpa.
 
Good luck! I wish you all the best. How are you planning on marketing your sites?
 
Thats a lot of work, Was thinking of doing something similar, But have no coding skills. So I'm concentrating on putting the prompts is sequence, and proper tatgetting of keywrords. Internal linking is going to be a huge part of this,

Anyway it will be interesting to see how you are getting on.
Your right about story telling though. Get that right and you have the jump on everybody.
 
How do you create content outline for an article? do you prompt GPT to create generate outline?
 
Best wishes to you. I've got two questions.

How do you monetize the website?
Have you purchased expired domains for this project?
 
Best of luck! I am doing something very similar. Will be following your progress closely.
 
Good luck! I wish you all the best. How are you planning on marketing your sites?
>> Thanks! No marketing at all and I'm getting traffic
Thats a lot of work, Was thinking of doing something similar, But have no coding skills. So I'm concentrating on putting the prompts is sequence, and proper tatgetting of keywrords. Internal linking is going to be a huge part of this,

Anyway it will be interesting to see how you are getting on.
Your right about story telling though. Get that right and you have the jump on everybody.
>> It's totally doable.

I'd say, start with python and the openai API. Start slow. take it like archery when you start archery, you don't start 100m away from the target, but maybe 3m.

what I'd do:
1) ask the API to write something based on a prompt, everything stored in your code, print the output
2) ask the API to write something based on a prompt stored in a txt file and store the output in a txt file

and it goes one, start small with an iterative approach
Good luck with your journey. Have you monetized any of the sites yet? I would love to see some GSC screenshots, if you don't mind. :D
>> No monetization yet, but it will be a mix of ads/affiliate links - I will definitely post screenshots of GSC when results will be worth enough :)
How many visits do they have and how much money are you making
my most recent one is getting 10-20 uv/days, which is in the niche that has the most potential / less competition
How do you create content outline for an article? do you prompt GPT to create generate outline?
I use the API to generate the outline of the article based on the PAA scrapper and the context scrapper, then I ask the API to write the article based on several prompt that use Re3 algo
Best wishes to you. I've got two questions.

How do you monetize the website?
Have you purchased expired domains for this project?
No monetization for now. It will be a mix of ads/affiliate links
I have a mix of brand new/expired domains (with 20-40DR)
 
A small update:

I reworked my outline generation function: it now generates consistent outlines for silo articles and stores it in a CSV that directly feeds the content_generation function.
It takes ~1-2min to generate an outline for a silo article (5-10 subtopics) with quality control (is it relevant to the topic or not?)
Why do I want to generate outlines first, store them in a csv and then feed it to the content generation part? And not generate outlines on the fly? Because I want to be able to review the outlines by myself until I have a good enough quality control system.

I'm now working on Re3, I want better engaging articles, with a nice flow, so far it can generate articles 2-12k words long, but it misses something to make it engaging enough and get rid of the tendency of the model to try to extend the article length with empty stuff.
 
Can you give more details bout recursive reprompting?

Do you generate the outline and then iterate through each H2, H3 to generate separate sections? What other steps do you do?

I tried Re3 in the past with Davinci03 without much success. My problem was that sometimes it would decide to add an introduction for a section that suppose to be in the middle of the article or continue generating content and adding additional subsections.
 
GPT3 lacks of lookbacks so you have to do it yourself, that's why you have issues with intro/conclusion everywhere

Kevin Yang's work https://people.eecs.berkeley.edu/~yangk/ can give you solid ideas to implement a simplified Re3: outline, write, lookback, rewrite
Can you give more details bout recursive reprompting?

Do you generate the outline and then iterate through each H2, H3 to generate separate sections? What other steps do you do?

I tried Re3 in the past with Davinci03 without much success. My problem was that sometimes it would decide to add an introduction for a section that suppose to be in the middle of the article or continue generating content and adding additional subsections.
 
Good fortune! I'm hoping the best for you. How do you intend to promote your websites?
 
Hey there,

Wow, it sounds like you've been on quite the journey - from making bank with fiction books to diving into the world of GPT and Python. It's great to see your willingness to learn and adapt as technology evolves.

I have to admit, I'm impressed with your ability to create three different websites using various approaches and functions. It seems like you're always looking for ways to improve and optimize your work, which is a great trait to have.

I'm particularly intrigued by your focus on improving content quality through Re3 and hiring a tutor/teacher. It's always helpful to have a fresh perspective and guidance when tackling new challenges. And as for your desire to streamline your processes and create a better UI, well, we could all benefit from a little more efficiency and user-friendliness in our lives!

So, I'm curious - what inspired you to make the switch from fiction to non-fiction, and then to delve into AI and coding? And what are some of the biggest challenges you've faced along the way?

Looking forward to continuing the conversation!
 
Back
Top