1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

WTF My WP-O-MATIC Cron-Job is Indexed??

Discussion in 'Blogging' started by HustlinHard, Jan 17, 2009.

  1. HustlinHard

    HustlinHard Regular Member

    Joined:
    Nov 11, 2008
    Messages:
    202
    Likes Received:
    74
    Guys, maybe someone can help me with this, My cron-job was indexed before my site, I have a feeling this may not be a good thing (to have my cron indexed). I have a robots.txt file in my main directory that disallows entry into most of the wp folders, the robots.txt looks like this:

    Code:
    Sitemap: /sitemap.xml
    
    User-agent: *
    Disallow: /wp-content/cache/
    Disallow: /wp-content/themes/
    Disallow: /wp-content/plugins/
    Disallow: /wp-admin/
    Disallow: /wp-includes/
    Disallow: /wp-login.php 
    I inserted an .htaccess file into the main dir last night to test it out as some people said that works better than a robots.txt, but this morning I tried to check my site and got a 500 internal error and the cron-jobs weren't working etc.. When I removed all the info from the .htaccess and made it blank, the error went away (after a bit of time). Not sure if the two are related but I have a feeling they were. The .htaccess file I used was:

    Code:
    < Directory /wp-content/plugins/>
    Order deny,allow
    Deny from all
    </Directory>

    Right now I have the robots.txt in the main dir, and the .htaccess blank. The following is the cron-job url that is indexed by google.

    Code:
    http://www.mydomain.info/wp-content/plugins/wp-o-matic/cron.php?code=XXX........

    Please tell me if this is something I should worry about, and what I should do. BTW, as of right now my domain is indexed as well, but that is a recent development, earlier today the cron was the only part of my site that was indexed.
     
  2. confined

    confined Regular Member

    Joined:
    Jan 4, 2009
    Messages:
    216
    Likes Received:
    91
    yeah that's bad, you should change the directories of all your plugins or something... That htaccess code fucked up my site as well. I have to dig in and find the correct working code.

    You're using hostgator aren't you? their shit doesn't work well with that htaccess code. I will find a solution.
     
  3. HustlinHard

    HustlinHard Regular Member

    Joined:
    Nov 11, 2008
    Messages:
    202
    Likes Received:
    74
    actually this blog is on dreamhost, I do also have a hostgator account though. Shit... This might fuck me bad..
     
  4. confined

    confined Regular Member

    Joined:
    Jan 4, 2009
    Messages:
    216
    Likes Received:
    91
    well for me I chose to have my permalink set to "Custom: /%postname%/"

    And any request to my wp-content/plugins URL on my sites simply makes wordpress think its a post so it tries to redirect. Maybe you should try changing that option under "Permalinks" in WP admin. try it and let me know if you can still access the cron by typing it in
     
  5. HustlinHard

    HustlinHard Regular Member

    Joined:
    Nov 11, 2008
    Messages:
    202
    Likes Received:
    74
    actually my permalink structure is the same as yours. I'm not sure what you mean by whether I can access the cron or not. When I type in the url (or click it in google) a blank page comes up and it seems that the cron was not activated (at least not yet). I'm not sure what this means.
     
  6. jack4ireland

    jack4ireland Junior Member

    Joined:
    Apr 13, 2008
    Messages:
    131
    Likes Received:
    42
    You can remove the URL from the index using the google webmaster tools
     
  7. HustlinHard

    HustlinHard Regular Member

    Joined:
    Nov 11, 2008
    Messages:
    202
    Likes Received:
    74
    I don't know if that would be the best of ideas, since i think that would immediately trigger a "review" of sorts. They say the removal of a site takes 3-5 business days, lol.
     
  8. porky

    porky Newbie

    Joined:
    Jan 18, 2009
    Messages:
    1
    Likes Received:
    0
    I think that putting this at the top of the .htaccess file should prevent a listing of your directories and deny access to the contents of your .htaccess file. (Note that I am not a coding expert, but I researched this some time back and found this code on what seemed to be a competent .htaccess coaching site.)

    Code:
    Options -Indexes
    
    <Files .htaccess>
    order allow,deny
    deny from all
    </Files>
    
    Perhaps a 301 redirect to home will flush the cron job out of the search index.
     
  9. agj32mrgibbits

    agj32mrgibbits Registered Member

    Joined:
    Mar 1, 2008
    Messages:
    73
    Likes Received:
    50
    You could chmod the script to where noone can view it and then run the cron to execute the PHP instead of using WGET.