Below is the answer and explanation for the purpose of a robots.txt file is to:
The purpose of a robots.txt file is to:
List the pages on a website to manage the content that’s shown to search engines.
Instruct search engines on how to handle duplicate content.
Instruct search en...