for our business site, where we had a dedicated server, we moved the server from 1 data center to another one and it DID negatively effect our ranking for few months. we had dedicated IP at both data center. the downtime was about 1 hour! so that could not be the reason for negative effect. just my 2 cents, that you could be negatively impacted.