Operator

Screaming Frog

Screaming Frog runs 2 bots across 1 agent type. Each one is a separate user-agent so you can allow or block them independently.

Bot

Type

Purpose

Description

Screaming Frog SEO SpiderSEO Crawler · Intel + audit

SEO Crawler

Intel + audit

Screaming Frog SEO Spider is operated by Screaming Frog. Maps link graphs, ranking signals, and audit data for SEO tooling. Typically run by SaaS platforms on behalf of marketers monitoring their own or competitor sites.

ScreamingFrogSEO Crawler · Intel + audit

SEO Crawler

Intel + audit

ScreamingFrog is operated by Screaming Frog. Maps link graphs, ranking signals, and audit data for SEO tooling. Typically run by SaaS platforms on behalf of marketers monitoring their own or competitor sites.