Index Your Blog Website On Google With Custom Robots.txt

Index Your Blog Website On Google With Custom Robots.txt 

Robots.txt is a text file on the server in that you can write which directories, web pages or links should not be included for search results. It means you can restrict search engine bots to crawl some directories and web pages or links of your website or blog. Now custom robots.txt is available for Blogger.

In this robots.txt you can also write the location of your sitemap file. A sitemap is a file located on a server which contains all posts’ permalinks of your website or blog. Mostly sitemap is found in XML format i.e. sitemap.xml.


In this blog, we will teach you about Custom Robots.txt  . Basically we have also setup a ads.txt , custom robots Header tags etc  . so, you will go to our previous Blog for learn about some setup and for your kind information we also have a YouTube channel, which we continuously uploaded videos of HTML, CSS, PHP, Blogger and Tech Videos. so please subscribe to our YouTube channel.



YouTube Channel :-  Kumar Atul Jaiswal



HOW To Set a Custom Robots.txt File on Blog ?

Step 1  :- First of all you go to the Blogger Dashboard.



Step 2  :-  Go to setting option.





Step 3  :-  Find a search prerefernce option and click on it.




Step 4  :-  and then find a custom robots.txt setup and click edit option.







Step 5  :-  You have to click on the option of yes and then you will see a  blank box in which you                          have to paste a code.   finally click to save.









 Code Given Below 

    User-agent: Mediapartners-Google
      Disallow:
      User-agent:
      Disallow: /search
      Allow: /

      Sitemap:  https://www.kumaratuljaiswal.in/sitemap.xml




Video on This Topic :-  



  


 
Have a Nice Stay Here : - )