Happen to face Google adsense crawl error, found the fix. It says, to make adsense to crawl your pages and show targetted ads, add these lines on top of robots.txt. Code: User-agent: Mediapartners-Google Disallow: But my robots.txt file has already had this lines Code: User-agent: Mediapartners-Google* Allow: / User-agent: Googlebot-Image Allow: /wp-content/uploads/ User-agent: Adsbot-Google Allow: / User-agent: Googlebot-Mobile Allow: / Someone explain me what these lines refer to and what is the difference between both. Which is the right one? Do I need to make any changes or just leave like that?