Robots.txt file plays vital role in SEO. It instructs search engine robots whether website/webpage should be crawled or not. This file should present in root path. If a search engine robot wants to visit...