Two different dedicated IP addresses for different subdomains of my website. Can Google penalize me?

Hello there,

I've got a website with 300,000+ pages, with different subdomains, in order to manage the two languages of the information I serve, and also the AMP pages I create:
- en.mysite.com
- amp-en.mysite.com
- fr.mysite.com
- amp-fr.mysite.com

Two of the domains ('en.mysite.com' and 'amp-en.mysite.com') are under a specific dedicated IP address and the other two ('fr.mysite.com' and 'amp-fr.mysite.com') under other different dedicated IP address.

I do not remember why I did this, but today I wondered if this could be penalized by Google in the SERP rankings. The case is that my webpages dropped one year ago, and I do not manage to obtain good rankings for the pages of 'fr' and 'amp-fr' subdomains.

Any tip is welcome. Thank you very much.

sub-domains are considered as separate entity from their main domain. So, having different IP's should not be a cause of worry.