# Served by Gitea at /robots.txt (GITEA_CUSTOM/public). #656: a crawler
# permuted every label-filter combination of the project board about once
# a second for weeks — filtered views are a combinatorial trap and carry
# nothing worth indexing. The traefik router `git-projects-filter` rate
# limits the same URLs for clients that ignore this file.
User-agent: *
Disallow: /*/*/projects
Disallow: /*/*/issues?
Disallow: /*/*/pulls?
Disallow: /*/*/milestones?
Disallow: /*?labels=
Disallow: /*?state=
Disallow: /*?sort=
Disallow: /*?q=
Disallow: /*/*/compare/
Disallow: /*/*/commits/
Disallow: /*/*/blame/
Disallow: /*/*/raw/
Disallow: /*/*/search
Disallow: /explore
Disallow: /api/
Crawl-delay: 10
