Question 1

Does robots.txt stop a page from being indexed?

Accepted Answer

Not reliably. A blocked URL may still appear in search results if other pages link to it. Use an appropriate noindex directive or authentication for private content.

Question 2

Where should robots.txt be published?

Accepted Answer

Publish it at the root of the host, such as https://www.example.com/robots.txt. Rules apply only to the protocol, host, and port where the file is served.

Question 3

Does this tool change my live website?

Accepted Answer

No. It checks the text in this browser. Copy your changes or download a robots.txt file, then publish it through your own hosting workflow.

Question 4

Can I use Disallow to hide sensitive paths?

Accepted Answer

No. Disallow rules are public and do not prevent direct access. Use authentication and authorization to protect sensitive resources.