# See https://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file User-agent: * Disallow: /users/password/new Disallow: /privacy Disallow: /terms Disallow: /z/t User-agent: archive.org_bot Disallow: /