Everything matters in my opinion: the age of your domain, the rate at which you built your links, the anchor text variety and the order that you built them, from what sources, PA and PR of the pages containing backlinks, user engagement metrics (time on site, bounce rate), and so on and so on...