How to use robots.txt

When a search engine crawls (visits) your website, the first thing it looks for is your robots.txt file. This file tells search engines what they should and should not index (save and make available as search results to the public). It also may indicate the location of your XML sitemap. The robots.txt file belongs in your "public_html" folder. It should be accessible with a link like www.youdomain.com/robots.txt

As a webmaster you may also be interested in managing search results on Google. This can be done with Google webmaster tools

How do I create robots.txt file?

You can simply create a blank file and name it robots.txt. This will reduce site errors and allow all search engines to rank anything they want.

If you want to stop search engines from ranking you, use this code:

User-agent: *
Disallow: /

Others try to sell you, what we offer for FREE

Our free hosting features

Price or any hidden costs? Free
Disk space 10GB
Bandwidth 100GB
Addon domains Unlimited
No ads yes
Email accounts 5
FTP accounts 5
MySQL database 5
Free Subdomains 5
Parked domain 5
Website builder, cPanel yes
FTP, PHP5, cURL & more yes

- Still hesitating? -

See all features