Operator
Netarkivet
Netarkivet runs 2 bots across 2 agent types. Each one is a separate user-agent so you can allow or block them independently.
Bot
kb.dk_botGeneric Crawler · General
Generic Crawler
General
kb.dk_bot is operated by Netarkivet. Generic programmatic data extraction with intent that varies case-by-case. Worth checking the operator before blocking, some are legitimate research, some are abusive.
netarkivindsamlingWeb Archiver · Archival
Web Archiver
Archival
netarkivindsamling is operated by Netarkivet. Preserves web content for archival or historical reference, snapshotting pages so they remain available even after the original is taken down.