Robots.txt

A Robots.txt file is a text file on a website that instructs search engine bots which pages or sections they should or should not crawl. It is an important tool for managing how search engines interact with a site.

Scroll to Top