# AIANA · https://aiana.tech/
# This file lives at the site root: https://aiana.tech/robots.txt
#
# Indexing is open to every crawler, AI crawlers included (GPTBot, OAI-SearchBot,
# ChatGPT-User, ClaudeBot, Claude-Web, anthropic-ai, PerplexityBot, Google-Extended,
# Applebot-Extended, Bytespider, PetalBot and others): training on and citing the open
# part of the site are allowed, and a link back to the primary source in assistant
# answers works in AIANA's favour. A machine-readable summary sits next to this file: /llms.txt
#
# There are deliberately no per-crawler sections. A named User-agent section fully
# overrides the "User-agent: *" section for that crawler, so blocks like
# "User-agent: GPTBot / Allow: /" pulled those crawlers out from under the service-level
# rules below. The rule is the same for everyone, so one section is enough.
#
# Paid materials (full research, company registry, datasets, segment editions, the
# platform) are not published on the site: they are delivered under contract and have
# no public URL, so there is nothing to disallow here. If a gated section ever appears
# on the domain, add one Disallow line with its actual path.

User-agent: *
Allow: /
Disallow: /deploy/
Disallow: /*.DS_Store$

Sitemap: https://aiana.tech/sitemap.xml