what is robot.txt??

Status
Not open for further replies.
Advertise on BHW
Here is the definition of robots.txt from Yahoo Answers:

http://answers.yahoo.com/question/index?qid=20110715205416AAfMdYe

And here is Wikipedia's answer regarding XML site maps:

http://en.wikipedia.org/wiki/Site_map

Cheers! - "Wiz"

PS: Google is your friend. :)
 
i personally wouldnt pick any nation because there are 'experts' everywhere
 
A kind of Robot using it, so you need not worry about it
 
Taylorwattson said:
Robots.txt is a text file used to give instructions to the search engine crawlers about the caching and indexing of a webpage, domain, directory or a file of a website.

•Its like the front door to your house!
•Can block search engine robots, or let them see that you want them to see.
– Great for hiding duplicate content on your site!
–Other features as well we'll get into later.
•Remember it has an impact on link juice!
Click to expand...

Thread is 6 years old, better check the date before posting.
Nywz Welcome to BHW
 
Advertise on BHW
Status
Not open for further replies.
Sign up now!

Main Menu

Home Main Forum List Black Hat SEO White Hat SEO BHW Newbie Guide Blogging Black Hat Tools Social Media Downloads

Marketplace

Account Selling Content / Copywriting EBooks / Methods Hosting Misc Proxies For Sale SEO - Link building SEO - Packages Social Media Social Media - Panels Web Design More

Making Money

Affiliate Programs Hire a Freelancer IM Journeys Making Money Pay Per Click Site Flipping Want to Buy

BlackHat World

Dispute Resolution Forum Suggestions & Feedback Introductions Lounge
Back
Top