1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Found out why my site wasnt gettin on indexed

Discussion in 'Black Hat SEO' started by BlackxHat, Mar 12, 2010.

  1. BlackxHat

    BlackxHat Power Member

    Joined:
    Oct 6, 2009
    Messages:
    591
    Likes Received:
    78
    Privacy settings were set so that it's blocked on Google/search engines, wtf all this time i was cracking my head about why it didnt get index for 2 months. this happen to anyone else? how long would it take to get indexed now?
     
  2. wowhaxor

    wowhaxor Executive VIP Premium Member

    Joined:
    Apr 28, 2007
    Messages:
    2,021
    Likes Received:
    3,361
    Location:
    ?¿?
    Home Page:
    Indexing is pretty quick. Throw some links/ping it and you should be up quick. Usually a blast to some social bookmarking sites gets me indexed within a matter of hours.

    I did something similar with a WP blog once, clicked that option to hide the blog from SEs... doh!
     
  3. wickid12

    wickid12 Regular Member

    Joined:
    Dec 4, 2009
    Messages:
    363
    Likes Received:
    36
    Yeah I did that to my WP blog once and I was wacking my brains why I wasn't getting indexed. Just delete the robots.txt if you click the box by accident.
     
  4. BlackxHat

    BlackxHat Power Member

    Joined:
    Oct 6, 2009
    Messages:
    591
    Likes Received:
    78
    im kinda new to this, and just heard about robots.txt few days ago, Do i have to upload one?
     
  5. Deviance

    Deviance Regular Member

    Joined:
    Apr 14, 2009
    Messages:
    205
    Likes Received:
    143
    Are you using Wordpress?
     
  6. theguy2

    theguy2 Regular Member

    Joined:
    Feb 2, 2010
    Messages:
    251
    Likes Received:
    51
    Occupation:
    Building Massive Backlinks and dominating SERPs
    Home Page:
    my site didnt get indexed till i uploaded robot.txt so u would do goodd to upload it too and then use identi.ca to get the site indexed in g00gle immediately
     
  7. Hellfire

    Hellfire Regular Member

    Joined:
    Jun 27, 2009
    Messages:
    241
    Likes Received:
    150
    Occupation:
    Student
    Location:
    Norway
    Atleast the Hostagor fantastico sets WP to privacy at default.
     
  8. BlackxHat

    BlackxHat Power Member

    Joined:
    Oct 6, 2009
    Messages:
    591
    Likes Received:
    78
    Yes its WP, and i dont understand why its set block SE's as default, its so stupid
     
  9. foxriver

    foxriver Junior Member

    Joined:
    Aug 9, 2009
    Messages:
    108
    Likes Received:
    76
    Home Page:
    Yes its WP, and i dont understand why its set block SE's as default, its so stupid

    I think they do it this way because when someone uploads and starts a new blog they will mess around changing blog settings, themes, practice posts etc......in other words there is much testing at times. Some people rather not let the search engines find this preliminary search engine fodder ....thus the option to hide from the spiders.

    I read about it a while ago.....I thought they got rid of it with the new wp version....haven't checked though, but I'm always aware of it because I would hate to go through what you did.

    Glad you figured it out though!!!!
     
  10. turbopugsleylx

    turbopugsleylx Jr. VIP Jr. VIP Premium Member

    Joined:
    Jun 6, 2008
    Messages:
    3,197
    Likes Received:
    968
    Occupation:
    www.xgcmedia.com
    Location:
    www.xgcmedia.com
    Home Page:
    I have a site hosted on weebly...its just a one pager...is there anyway I can look at the code and see if it's able to be crawled by google?
     
  11. HowardOnline

    HowardOnline BANNED BANNED

    Joined:
    Feb 28, 2010
    Messages:
    243
    Likes Received:
    25
    That is stupid of wordpress
     
  12. aphroditetour

    aphroditetour Newbie

    Joined:
    Feb 9, 2010
    Messages:
    12
    Likes Received:
    0
    my site is also not getting indexed from google. i checked from http://www.ismyblogworking.com. The result shows its fine. I don't know what's the problem, just banging my head against the wall:(
     
  13. turbopugsleylx

    turbopugsleylx Jr. VIP Jr. VIP Premium Member

    Joined:
    Jun 6, 2008
    Messages:
    3,197
    Likes Received:
    968
    Occupation:
    www.xgcmedia.com
    Location:
    www.xgcmedia.com
    Home Page:
    that is my blog working is a good tool man!
     
  14. xboxps3wow

    xboxps3wow Power Member

    Joined:
    Jan 15, 2010
    Messages:
    737
    Likes Received:
    239
    Occupation:
    student
    Location:
    Chicago
    haha, that happened to me when i made my first wp... good think i caught it few days after when i was going thru the options just to see what they all did
     
  15. turbopugsleylx

    turbopugsleylx Jr. VIP Jr. VIP Premium Member

    Joined:
    Jun 6, 2008
    Messages:
    3,197
    Likes Received:
    968
    Occupation:
    www.xgcmedia.com
    Location:
    www.xgcmedia.com
    Home Page:
    Hey guys I have a domain that forwards and masks to a weebly page...

    I ran my web address thru www.ismyblogworking.com

    what does this mean to you guys...

    --It looks like your blog uses frames. This is substandard and will probably harm your search engine ranking.
    --Your blog doesn't advertise an XML feed. Are you sure it's a blog?
    --Your robots.txt file Content-type should be text/plain not text/html; charset=utf-8 (see here).
    --Your robots.txt file appears to be invalid:
    Line 2:

    1.
    2. <!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01//EN"
    3. "http://www.w3.org/TR/html4/strict.dtd">
    4. <html>


    Though when I ran my weebly domain thru that site it WAS showing that the weebly was indeed indexed google(though the godaddy domain I had forwarding and masking set up thru wasnt)

    Heres what it said about the weebly domain....

    "Your robots.txt file is missing. Technically speaking a robots.txt file is not required, but it's better to have an empty one than none at all."

    How could I fix this/circumvent this issue on a site like weebly (Where I can go in and edit my sites html/css/coding)

    Any thoughts?