CC0IndexerBot

User-Agent: CC0IndexerBot/0.1.2 (+https://cc0.example.invalid/bot; contact: abuse@example.invalid)

This crawler is designed to index only pages that expose exact CC0 or Public Domain Mark signals. It obeys robots.txt, refuses private-network targets, rate-limits requests, and stores metadata plus small snippets by default.

Rules

• No login, private, local, or protected pages.
• No general open-web crawling unless the domain is explicitly allowlisted.
• No accepted record without exact CC0/Public Domain Mark evidence.
• Removal requests are accepted through the takedown page.

Back to search