Operator
Netarkivet
Netarkivet runs 2 bots across 2 agent types. Each one is a separate user-agent so you can allow or block them independently.
Bot
kb.dk_botData Scraper | General
Data Scraper
General
kb.dk_bot is operated by Netarkivet. Generic programmatic data extraction with intent that varies case-by-case. Worth checking the operator before blocking, some are legitimate research, some are abusive.
netarkivindsamlingWeb Archiver | Archival
Web Archiver
Archival
netarkivindsamling is operated by Netarkivet. Preserves web content for archival or historical reference, snapshotting pages so they remain available even after the original is taken down.