Now, Create 'robots.txt' file at your root directory. Copy above text and paste into the text file.
Generate robots.txt files that help ensure that Google and other search engines crawl and index your site correctly.