In our previous, we had discussed about Submit Blogger Sitemap To Google and here we are back with another great and most important tutorial for all of you. Today we are going to enable a custom Robots.Txt file in Blogger which can really help you to index your blog in Google faster and it will also make your blog more search engine friendly. Robots.Txt file is used in every website but in the past with old Blogger interface we are unable to add that file in our blogs but now in the new interface which is really amazing with a lot of great features we can enable that file in Blogger. Those who don't know about Robots.Txt file can read the below post to understand that file.
What is Robots.Txt File ?
That is a simple text file in which the website owner use to write the commands for the search engine's crawler. It means that we can instruct the search engine's crawler with that file that we part of our site can be indexed or not. That commands are written in different coding which is only for search engine's crawler. You can see your robots.txt file just by following the below URL.
http://www.yourdomain.com/robots.txt
What Areas You Should Disallow For Crawling In Your Blog?
So, This question maybe coming in your mind that which areas of your blog you should disallow for crawling. In fact, You can disallow any area of your blog but there are some important areas for disallowing. If you disallow those areas then you blog will be more search engine friendly and that areas are Search Result pages, Archive pages and labels pages. However, Below I'm giving you an search engine friendly robots.txt file which will help you a lot.
Also Read : Mind Blowing Benefits of Blogging
Enable Custom Robots.txt File In Blogger
So, This process is so easy just follow the simple steps below.
- Go To Blogger > Settings > Search Preferences
- Look For Custom Robots.Txt Section In The Bottom and Edit It.
- Now a check box will appear tick mark "Yes" and a box will appear where you have to write the robots.txt file. So if you want to use our file then copy the code below and paste it in that box.
User-agent: Mediapartners-Google
User-agent: *
Disallow: /search?q=*
Disallow: /*?updated-max=*
Allow: /
Sitemap: http://www.yourdmomain.com/feeds/posts/default?orderby=updated
- Note : The first line "User-agent: Mediapartners-Google" is for Google AdSense. So if you are using Google AdSense in your blog then remain it same otherwise remove it.
- Click "Save Changes".
Final Word
So friends, It was our robots txt file which is going to help you definitely. We will be back with other great tutorials of search engine optimization. Thanks for watching Blogger Sitemap post.