# This archive mirrors and indexes content from public mailing lists.
# Copyright in individual messages belongs to their authors, who may
# grant or withhold AI-related permissions independently of what is
# stated here.
#
# The Content-Signal directives below express two things on top of
# the messages themselves:
#
# 1. The operator's preferences for how this archive is accessed and
#    used.
# 2. A reservation of any rights the operator holds in the
#    compilation (index, deduplication, threading, cross-list
#    resolution, rendering), including sui generis database rights
#    under EU Directive 96/9/EC on the legal protection of databases.
#
# As a condition of accessing this site, you agree to abide by the
# following content signals:
#
# (a)  If a Content-Signal = yes, you may collect content for the
#      corresponding use.
# (b)  If a Content-Signal = no, you may not collect content for the
#      corresponding use.
# (c)  If a Content-Signal is not set for a use, the operator
#      expresses no preference for that use.
#
# The content signals and their meanings are:
#
# search:   building a search index and providing search results
#           (returning hyperlinks and short excerpts from this site's
#           contents). Search does not include providing AI-generated
#           search summaries.
# ai-input: inputting content into one or more AI models (e.g.,
#           retrieval-augmented generation, grounding, or other
#           real-time taking of content for generative AI search
#           answers).
# ai-train: training or fine-tuning AI models.

User-agent: *
Content-Signal: search=yes, ai-input=no, ai-train=no
Crawl-delay: 5
Disallow: /*/attachment/
Disallow: /api/
Disallow: /*/search

User-agent: Amazonbot
Disallow: /

User-agent: Applebot-Extended
Disallow: /

User-agent: Bytespider
Disallow: /

User-agent: CCBot
Disallow: /

User-agent: CloudflareBrowserRenderingCrawler
Disallow: /

User-agent: GPTBot
Disallow: /

User-agent: Google-Extended
Disallow: /

User-agent: SemrushBot
Disallow: /

User-agent: TikTokSpider
Disallow: /

User-agent: YandexBot
Disallow: /

User-agent: meta-externalads
Disallow: /

User-agent: meta-externalagent
Disallow: /

User-agent: meta-externalfetcher
Disallow: /

User-agent: meta-webindexer
Disallow: /

Sitemap: https://ratatoskr.run/sitemap.xml