A robots.txt file is a file at the root of your site that indicates those parts of your site you don’t want accessed by search engine crawlers.