# Allow Google's crawler User-agent: Googlebot Allow: / Disallow: /*/login Disallow: /*/signup Disallow: /*/account-confirmation Disallow: /*/customer-account Disallow: /*/reset-password Disallow: /*/order-confirmation # Allow Facebook's crawler for link previews User-agent: facebookexternalhit Allow: / # Allow Facebook's catalog crawler User-agent: facebookcatalog Allow: / # Block all other crawlers User-agent: * Disallow: / # Sitemap # Sitemap: https://apiv4.dineoncampus.com/sitemap.xml