Robots.txt Generator — illustrative example

INPUT
Allow public pages; ask crawlers not to crawl /internal-preview/.

RESULT
User-agent: *
Disallow: /internal-preview/
Confirm that private resources also require access control.

REVIEW
Robots rules control crawling, not reliable removal from search results. Match the correct crawler syntax and never use robots.txt to protect confidential data.

This is a teaching example, not a live execution record.