# Robots.txt for https://welcome.ai User-agent: * Allow: / Disallow: /dashboard Disallow: /auth Disallow: /profile-setup # Sitemaps Sitemap: https://welcome.ai/sitemap.xml # Crawl-delay (in seconds) Crawl-delay: 1