Google is always dancing around, I experience this on a daily. I tend to not look at rankings for a 24 hour period, it is not a long enough period to really track anything.
Exactly, you need to get large enough sample of data. Making any drastic moves based on a few hours data is an amateur move and what Google wants you to do.