Great to see Google has expanded its guide to robots.txt https://developers.google.com/search/reference/robots_txt

Remember robots.txt will not prevent a site from being indexed, only a noindex meta tag/HTTP header will do that. https://yoast.com/prevent-site-being-indexed/