[Journey] 1 million UVs/month in 12 months using AI generated content. Let's do it!

Status
Not open for further replies.
Hello !

Which plugin / tool are you using to insert bulk post ? I tried some plugins and wordpress_xmlrpc in python but it takes 1 second per post, too slow when I want to insert 100k+ on different websites...

Should I insert in the database directly with SQL requests ?

Thanks
 
Hello !

Which plugin / tool are you using to insert bulk post ? I tried some plugins and wordpress_xmlrpc in python but it takes 1 second per post, too slow when I want to insert 100k+ on different websites...

Should I insert in the database directly with SQL requests ?

Thanks
I code everything myself. WordPress REST API.
 
the REST API will not be your bottleneck, trust me ;)
I just tried on a newly installed wordpress and it takes 1 second per 1/2 post too, it seems to me it's the wordpress functions used to create posts that are very slow. Because I get same result with every method I use, (RPC / REST API / Plugins) they probably all use the same "create post" wordpress function) So API is not the bottleneck but the "create post" function used by API may be... Don't you have the same problem? Did you find a solution to bulk post hundreds of posts within few seconds?
 
I just tried on a newly installed wordpress and it takes 1 second per 1/2 post too, it seems to me it's the wordpress functions used to create posts that are very slow. Because I get same result with every method I use, (RPC / REST API / Plugins) they probably all use the same "create post" wordpress function) So API is not the bottleneck but the "create post" function used by API may be... Don't you have the same problem? Did you find a solution to bulk post hundreds of posts within few seconds?
generate a XML export file where you first create all the posts locally with say 100k posts, then you can import the file in wordpress.
 
generate a XML export file where you first create all the posts locally with say 100k posts, then you can import the file in wordpress.
That's what the plugin I tried does. But when I import the file, it then takes 1 second per post too.
 
That's what the plugin I tried does. But when I import the file, it then takes 1 second per post too.
well you could directly insert it in the mysql db too with multithreads, thats as fast as it gets.
i dont think you will be able to insert 100s per second through the api, as each post requires some processing time.
 
That's why I'm asking Sartre if he really succeeded to insert in bulk using the REST API because he said was doing like that.

Inserting directly in the database with MySQL was my first idea, but I saw it was not recommended because it could cause hard to debug problem if badly done. I prefere trying safe solutions first
 
Great job man! Just curious how do you monetize from these sites..Im assuming Google ads will get suspended at some point with these sites?
 
That's why I'm asking Sartre if he really succeeded to insert in bulk using the REST API because he said was doing like that.

Inserting directly in the database with MySQL was my first idea, but I saw it was not recommended because it could cause hard to debug problem if badly done. I prefere trying safe solutions first
wp is not really designed to create posts in masses, so they didnt take into account that people might want to create hundreds of thousands of posts a day.
if you want to create hundreds of thousands or millions of pages a day, its best you use static HTML or create a custom PHP solution.
 
wp is not really designed to create posts in masses, so they didnt take into account that people might want to create hundreds of thousands of posts a day.
if you want to create hundreds of thousands or millions of pages a day, its best you use static HTML or create a custom PHP solution.
you're right. My way is more in the thousands of posts. if I go over 10k, I remove posts that are not performing well.

WordPress is not designed to handle huge sites.
 
is 1 post per second really not enough for you? Generating a post takes more than 1 second, so the REST API is most likely not the bottleneck.

1 post per second is 86k posts/day.
holy shit and here I was thinking I was killing it generating 50 posts/day with wp-auto - You guys never fail to amaze.
 
That's why I'm asking Sartre if he really succeeded to insert in bulk using the REST API because he said was doing like that.

Inserting directly in the database with MySQL was my first idea, but I saw it was not recommended because it could cause hard to debug problem if badly done. I prefere trying safe solutions first
@Sartre rightly pointed out that the creation process takes much longer than 1 second to create a post, so unless you already have all the posts "ready" to be "imported", there really isn't much point in dedicating yourself to improving the wordpress post generation time.

Are you absolutely sure that it is absolutely necessary to get all these posts in one day?
If you divide this mass of posts over several days, what problem can there be?

However, from my experience, it is not convenient to populate a site with a lot of content in the past, but it is preferable to insert posts with future dates. So for this too it makes sense to create posts on some days and not all at once.
But maybe someone on the forum has more experience and can contradict me.
 
@Sartre

  1. you mentioned in the past that you are not using GPT3 but some other AI writer. Is that AI writer available on the internet or is that some private thing?
  2. How does it compare to GPT3?
  3. DO you think you could have the same success with GPT3/chatgpt? If yes, why not use it instead?
  4. Does your AI writer cost you any money to generate text? (except servers, proxies etc)
  5. How do you avoid thin content with AI?
Any tips would help a lot.
 
Last edited:
@Sartre

  1. you mentioned in the past that you are not using GPT3 but some other AI writer. Is that AI writer available on the internet or is that some private thing?
  2. How does it compare to GPT3?
  3. DO you think you could have the same success with GPT3/chatgpt? If yes, why not use it instead?
  4. Does your AI writer cost you any money to generate text? (except servers, proxies etc)
  5. How do you avoid thin content with AI?
Any tips would help a lot.
You can 100% create a fantastic tool using GPT3 using multiple prompting and repromptings (davinci003).

How to avoid thin content. That's a very complex answer. Gotta make sure the AI is generating answers on point, the flow is good, and no repetitions. + add rich content
 
Always get excited when i saw computer science people come in this filed Because I'm also computer science student will be awesome to see your journey wish you very good luck
 
Status
Not open for further replies.
Back
Top