1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

[ ASK ] Setting robot.txt

Discussion in 'White Hat SEO' started by hoysi, Mar 8, 2015.

  1. hoysi

    hoysi Registered Member

    Joined:
    Jan 29, 2015
    Messages:
    77
    Likes Received:
    3
    How to setting robot.txt in wordpress?, i want google adsense crawler indexing my site,
    im confused, where robot.txt?

    User-agent: Mediapartners-Google
    Disallow: /
     
  2. seapunk

    seapunk Registered Member

    Joined:
    Dec 28, 2014
    Messages:
    85
    Likes Received:
    20
    Make a file called robots.txt in your website's root directory, and place what you need inside. What are you having trouble with?
     
  3. bartosimpsonio

    bartosimpsonio Jr. VIP Jr. VIP Premium Member

    Joined:
    Mar 21, 2013
    Messages:
    12,489
    Likes Received:
    11,190
    Occupation:
    CHEAP
    Location:
    DATASETS
    Home Page:
    With that setting you'll be blocking the Adsense user agent. Is that what you want?