1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Robot.tx im to stupid

Discussion in 'Blogging' started by Sergi10, Jun 2, 2017.

  1. Sergi10

    Sergi10 Newbie

    Joined:
    Mar 15, 2017
    Messages:
    31
    Likes Received:
    1
    Gender:
    Male
    Hey guys I created a blog and im trying to figure out the SEO stuff and read some guides here. Well, im already kind of into it, connected my sitemap with google and im working with seo yoast for my posts, which works pretty good.

    BUT i need to include this robot.tx file, and I have a) no idea how to create it b) where to upload it and c) im just lost

    Any help is appreciated!

    Im using IPage + Wordpress
     
  2. fheaky

    fheaky Regular Member

    Joined:
    May 3, 2010
    Messages:
    389
    Likes Received:
    112
    You don't really need a robots.txt if it's just a regular site where you don't want to block any crawlers.
     
  3. sam.hunt0710

    sam.hunt0710 Jr. VIP Jr. VIP

    Joined:
    Feb 22, 2011
    Messages:
    5,308
    Likes Received:
    1,905
    Gender:
    Male
    Occupation:
    Owner Of a IT Comapny
    Location:
    India
    Home Page:
  4. Sergi10

    Sergi10 Newbie

    Joined:
    Mar 15, 2017
    Messages:
    31
    Likes Received:
    1
    Gender:
    Male
    The problem is I tried to search my page in google (and it appeared) but it said "A description for this result is not available because of this site's robots.txt"
     
  5. TimelordHarry

    TimelordHarry Regular Member

    Joined:
    Apr 6, 2017
    Messages:
    234
    Likes Received:
    58
    Gender:
    Male
    Occupation:
    Tardis Enginner
    Location:
    Gallifrey
    Go to Google and do Google search for your problem. About 27,400 results (0.83 seconds) will appear to offer you a solution on this.
     
  6. TheDevloper

    TheDevloper Newbie

    Joined:
    Jul 31, 2015
    Messages:
    28
    Likes Received:
    3
    Occupation:
    Game Devloper
    Location:
    Tigumi
    Home Page:
    you can upload your robotx.txt file in your cpanel home (public_html). you can also acces your robots.txt via webmaster tools.
    good luck
     
  7. hellrete

    hellrete Newbie

    Joined:
    Jun 2, 2017
    Messages:
    40
    Likes Received:
    11
    Gender:
    Male
    "BUT i need to include this robot.tx file, and I have a) no idea how to create it b) where to upload it and c) im just lost"
    robot.txt file is a file you get from your Google account
    You make a web master account and add your site, then, to verify that is your site, you download the file robot.txt from the control panel from the admin area of Google Webmaster Tools.
    Once you have it to your PC you upload it to your root website as it website (dot) com.
    Your visitors will not see it but Google will.
    Also Google will know that is your site since you linked it earlier, remember?

    After all these steps are done you wait like 24h for Google to take his sweet time and verify everything is in order and voilĂ .
    You just added your site to Google for people to find it and to look around.

    Now if people would have a similar tutorial on how to make a certain page, or pages not apear in the normal searches you would be done.
    I am sure that this is not that hard but I am sure someone knows this and it is easy, but I don't know the procedure.

    Also relax, I remember learning this stuff and having headakes aswell, do not compare your page 20 to other's page 200.

    Best of luck to you and sorry.
     
  8. ezprogram

    ezprogram BANNED BANNED

    Joined:
    Jun 4, 2017
    Messages:
    28
    Likes Received:
    0
    Gender:
    Female
    upload it on the root directory of your website