What is robots.txt and what is it used for?

This content is being generated. Please check back in a few moments.