I Published 66k Articles and now when I search it returns a 504 Gateway Time out error

[Mukeshwar Singh]

SO, I published 66,000+ articles on my Wordpress site and it's on Vultr High Frequency 8GB server, and every time I search something, the server load jumps to 120% and it returns an error causing my site to be shut down for a minute or so. It's on Nginx, and I'm pretty sure it's related to large number of files.

But, what can I do now?

 

[SEOPartner]

When you use the WP search function?

 

[Ramazan]

Did u do that in 1 second? lmao i can feel that server situation

 

[Mukeshwar Singh]

When you use the WP search function?

Everytime I use, it just throws an error, I'm thinking what will happen if a lot of visitors started doing it? Will my site be off forever, lol

 

[Mukeshwar Singh]

Did u do that in 1 second? lmao i can feel that server situation

Nope, everything is done a long time ago, and it works fine if I enter the URL, however, when I search through the search bar, it just shows an error!

 

[SEOPartner]

Everytime I use, it just throws an error, I'm thinking what will happen if a lot of visitors started doing it? Will my site be off forever, lol

You can try the following:

- add an index in Mysql
- disable the search and use a Google site search instead, there is probably a WP plugin for that

 

[Mukeshwar Singh]

You can try the following:

- add an index in Mysql
- disable the search and use a Google site search instead, there is probably a WP plugin for that

Thanks, will check it out

 

[Zera Api]

Vultr High Frequency 8GB server

Did you check your storage settings ?

 

[hideath]

You can try the following:

- add an index in Mysql
- disable the search and use a Google site search instead, there is probably a WP plugin for that

+1 for this
take a look at this: https://wordpress.org/plugins/fulltext-search/
I'm pretty sure that there are some plugins that will help out solving this

 

[Mukeshwar Singh]

+1 for this
take a look at this: https://wordpress.org/plugins/fulltext-search/
I'm pretty sure that there are some plugins that will help out solving this

Thanks will check it out

 

[nahid133]

@Gogol
vultr issue

 

[Gogol]

@Gogol
vultr issue

Well... Could be many things. Primarily I think the innodb settings aren't correct. Could be much more than that, and the fact the I somehow think that vultr doesn't deliver what they promise. Also... Wp isn't really scalable lol. There's a reason why pros avoid using wp for big projects.

 

[AllyBarns]

66k articles? Whoaa!!
How did you do it? Purchased, rewrite, scrapped?

 

[BassTrackerBoats]

Should have made it 65.9K articles so you would not get the error.

 

[vario150]

Wordpress is resource hunger. Lots of trash and transient data stored. Especially with that number of posts.

Try wp-optimize

 

[doxul]

Well... Could be many things. Primarily I think the innodb settings aren't correct. Could be much more than that, and the fact the I somehow think that vultr doesn't deliver what they promise. Also... Wp isn't really scalable lol. There's a reason why pros avoid using wp for big projects.

Can you explain a bit about the alternate that pros use instead of wordpress? I am mainly interested in bogging.

 

[Gogol]

Can you explain a bit about the alternate that pros use instead of wordpress? I am mainly interested in bogging.

Frameworks. Yii2 is the one I prefer. It can be laravel. Can be django or flask if you prefer python. Could even be ruby on rails if you are feeling fancy. Just get out of this wp trap. You can't change shit in wp, and you have to work with the db scheme as well as the architecture you have. Switch to mvc/hmvc/mvvm. You will love it.

Edit: even a single server won't work if your site is really huge and you have really huge usage. You might want to have a separate server (possibly, many... using horizontal scaling) for db as well as for the app itself (same as db....many servers..). It can get really complex real quick.

 

[Mukeshwar Singh]

@Gogol
vultr issue

Which issue? Should I transfer to Linode?

 

[Mukeshwar Singh]

Well... Could be many things. Primarily I think the innodb settings aren't correct. Could be much more than that, and the fact the I somehow think that vultr doesn't deliver what they promise. Also... Wp isn't really scalable lol. There's a reason why pros avoid using wp for big projects.

Oh, so should I change to Linode?

 

[Mukeshwar Singh]

Should have made it 65.9K articles so you would not get the error.

I'm getting this since earlier but now the project is already complete, I wanted to re-test that, and it still persists!