User-agent: facebookexternalhit Allow: / User-agent: Facebot Allow: / User-agent: Twitterbot Allow: / User-agent: LinkedInBot Allow: / User-agent: TelegramBot Allow: / User-agent: Slackbot Allow: / User-agent: Discordbot Allow: / User-agent: WhatsApp Allow: / User-agent: * Disallow: /admin Disallow: /admin/ Disallow: /client Disallow: /client/ # Block admin and customer JSON APIs but ALLOW the public read-only API. # Googlebot's renderer MUST be able to fetch /api/v1/public/* — those # endpoints supply the product/translation/theme data the SPA reads at # render time. Blocking them causes the SPA to render its NotFound view # and emit ``, which then de-indexes # every product page. Belt-and-suspenders: the X-Robots-Tag middleware in # main.py keeps the JSON responses themselves out of the index. Disallow: /api/v1/admin/ Disallow: /api/v1/customer/ Allow: /api/v1/public/ Allow: / Sitemap: https://servera.lt/sitemap.xml