Looking for Selenium expert. Reduce CPU and Ram Usage if possible. ( want to run many sessions )

I am looking for someone who is very experienced with selenium and can help us to reduce the cpu and ram usage by a lot if that is even possible.

Our problem is that we wrote a bot which will run a lot of multiple sessions at the same time doing actions and for example if we do one action i see the CPU spike from 0.2% -> 20% and then instantly goes back to 0.2%.

Now we need to know if there is a way to reduce that kind of cpu usage because if 100 accounts do that at the same time it is impossible to handle for our servers

We pay good for the work

Simply limit the number of threads that can create new Selenium instances & then add a delay time afterwards, so that each instance opens up, uses CPU, drops back down, next instance opens & so on?

Or switch to web sockets?

Have messaged you about this

You can load performance enhancing extensions such as ad blockers, image blockers, CSS blockers etc to help lower the load. There's probably some performance tweaking parameters you can launch chrome with as well. I'm assuming it's selenium and chrome?

Why do you have to render the whole page? Could you just parse the html and do posts etc?

help us to reduce the cpu and ram usage by a lot if that is even possible

Click to expand...

Its not possible.
I use selenium daily for some of my automation tasks. Selenium use real browser, 100 accounts automated in real browser = you need very good CPU, alot ram and fast ssd.
No matter how much you gonna spend on reducing CPU usage effect will be negligible.
You have 2 options - look for powerfull dedicated server or look for software that dont use selenium for automation.

performance enhancing extensions such as ad blockers, image blockers, CSS blockers etc

Click to expand...

This in theory can reduce CPU usage but its not good idea. 100 as per OP post accounts using same set of browser extensions = footprint = you dont want to do this.

Mesage me. We have worked on a very similar task and I am sure we can help you.

I can help you with this.
Hit me on Skype: worknesty or PM for detailed information.

cheers