User-Agent: *
Allow: /
Disallow: /admin
Disallow: /api/
Disallow: /app/
Disallow: /billing/
Disallow: /dev/
Disallow: /login
Disallow: /favorites
Disallow: /profile

Sitemap: https://clawer.io/sitemap.xml