Googlebot is the robot of Google search engine which collects information from all the WebPages in the World Wide Web. It gathers all the information from your websites too. But you can manage the pages of your website which can be accessed by Googlebot or you can give direction to Googlebot to visit some pages of your website. But for this you need to upload the robot.txt in your web directory of your server. And you need to know the robot.txt language. It is a simple coding but all the webmasters are not good with the language of robot and some slight mistake in the coding of robot.txt can change the permission of your WebPages.
Now Google introduced automatic Google robot.txt generator in the Google Webmaster tools section. Now you do not need to know the robot language for making the robot.txt because you can directly generate the robot.txt files for your website by using the automatic Google robot.txt Generator tools. You will find this tool in the webmaster tool section of the Google. You just need to put the directories of your website in which you do not want Googlebot to visit and collect the information. You will find the detail information about the Google robot.txt Generator in the official website of Google. They are providing images of the Google robot.txt Generator and information on how it works.
