Yeah, you're going to want to open a new composition in After Effects and start dragging your images into position to replicate the videos you're referring to.
Read up on keyframing in After Effects, the animation in this video is very simple once you understand what keyframing is.