SEO & uptime monitoring with a Site Time Machine for your website
Crawleon crawls every page, records full SEO state and full-page screenshots, detects changes (even if they revert), and gives fast, visual answers: what changed, when, and how critical it is.
Built for speed and scale: parallel crawler, analytics, storage, multi-tenant security, and observability.
Core features
Everything is built around snapshots, full-page screenshots, and change intelligence. You see what changed, even if it’s not visible in the latest scan.
Site Time Machine
Browse any moment in time: screenshot + full SEO state (title, description, H1, canonical, robots, status code, speed) per page.
- Jump to a date and inspect exact page state
- Before/after view from timeline points
Snapshot Change Flags
Deterministic semantic change detection per snapshot. Severity: critical/high/medium/low.
- SEO: title/H1/description/content
- Indexability/robots, canonical/redirects
- Alt text, internal links, JSON-LD/microdata
Internal Links Diff
Store full internal links set and show added/removed links between scans to understand link-graph impact.
- Added/removed internal links per page
- Track link-graph changes over time
Alt text control
History of image alt text, before/after diff, and filters for missing or unstable alt.
- Missing alt detection
- Alt changed between scans
Pages view that never loses changes
Pages list shows current state plus change history window (24h/7d). Finds pages that “jumped” between scans.
- Filters: unstable, critical, title/H1/alt/links, slow pages, issues
- Not tied to last snapshot only
Live updates
SSE/WebSocket events while scanning: scan_finished, page_changed, uptime_up/down. Great for near real-time dashboards.
- Instant refresh of dashboards and pages
- Per-tenant event isolation
Fast crawler
Parallel crawl, URL normalization, robots/meta/X-Robots, redirects, JSON-LD/microdata collection, scheduled intervals by plan.
- Pages/sec scan speed metrics
- Per-tenant concurrency and timeouts
Screenshots storage
Headless Chrome full-page + thumbnail screenshots, stored in S3-compatible storage with signed URLs for secure viewing.
- Full screenshot history by plan retention
- Optional dedicated storage / BYO storage
Multi-tenant security
All queries are filtered by tenant_id. JWT includes plan/limits. Separate queues/streams per tenant.
- Tenant-safe APIs and analytics
- Admin panel: tenants on/off, plan limits
Dashboards and analytics
Aggregated analytics across scans: status codes, speed, changes timeline, and unstable pages. Built for large sites and teams.
Project Dashboard
Pages count, critical issues (today / last 7 days), OK pages %, last scan time, scan speed (pages/sec), status code distribution (pie + timeline), and page speed charts.
Changes timeline and summary
Changes dynamics across the site, severity split, and “most unstable pages”. Click any point to open a before/after snapshot with screenshot and SEO fields.
- Filters: severity, section, change types (title/H1/robots/canonical/alt/links)
- Pages view is history-aware (24h/7d window), not last-snapshot only
- Live events: scan_finished, page_changed, uptime_up/down
All analytics are designed for no-sql aggregations and fast UI loading.
How it works
A daily scheduled scan for every project, with fast crawling and deterministic change detection. Everything is stored as time series for quick dashboards.
1. Crawl
Parallel crawler discovers pages, normalizes URLs, respects robots/meta/X-Robots, and follows redirects (controlled).
2. Snapshot
For each page, Crawleon stores SEO state, status code, response time, structured data signals, and internal links set.
3. Screenshot
Headless Chrome captures full-page screenshot + thumbnail and stores them in S3-compatible storage with signed URLs.
4. Detect changes
Semantic change flags are computed versus the previous snapshot of the same page; severity is assigned deterministically.
5. Aggregate
No-sql stores time series and powers fast dashboards: health, changes, speed, unstable pages, and status code timelines.
6. Stream updates
During scans, UI updates via SSE/WebSocket events. You can integrate notifications later if needed.
Pricing
All plans include full screenshots and full functionality. Limits are based on monitored URLs and screenshot retention. Scans are scheduled once per day.
Free
Starter
Pro
Dedicated Add-on
Optional: if you want longer screenshot history, you can attach dedicated storage (managed by us) or connect your own S3-compatible bucket (BYO storage).
Who Crawleon is for
Crawleon is built for teams that need evidence, speed, and clarity. Screenshots + SEO-state snapshots turn regressions into obvious, actionable facts.
SEO agencies
Monitor client sites, see SEO diffs, internal links and alt history, and catch critical regressions fast.
- Change timeline by severity
- “Unstable pages” filtering
E-commerce and large websites
Track status codes, speed, page loss/new pages, and content changes across frequent deployments.
- Health dashboards and drift visibility
- Time Machine for any page
Product and DevOps teams
Uptime monitoring and screenshots as proof of UI regressions, with metrics and live scan events.
- scan_finished, page_changed, uptime events
- observability
Start with the Free plan
Create your first project, add a domain, and get the first daily scan with screenshots and change flags.
Want a dedicated instance?
If you need custom retention and storage, bring your own hardware/storage and pay €200/month for the software. Dedicated resources, custom limits, and isolation.
FAQ
Clear answers about scanning, screenshots retention, and how changes are displayed.
Why not show only the latest scan in Pages?
Because changes can appear and revert between scans. Crawleon’s Pages view shows current state plus a history window (24h/7d) and flags pages that changed recently or frequently.
What exactly is stored in a snapshot?
Full SEO state (title, description, H1, canonical, robots), status code, response time, internal links set, alt signals, and structured data presence (JSON-LD/microdata). Each snapshot also contains deterministic change flags versus the previous snapshot.
Do all plans include full-page screenshots?
Yes. All plans include full-page screenshots and the full feature set. Plans differ by monitored URLs and screenshot retention: 10/30/60 days.
Can I keep screenshots longer than the plan limit?
Yes. You can attach dedicated storage (customer-funded disk) or connect your own S3-compatible bucket. Dedicated Add-on also supports custom limits and settings.
Is Crawleon multi-tenant and secure?
Yes. All queries are filtered by tenant_id. JWT includes plan/limits, and event streams/queues can be isolated per tenant. Observability.
Is the scan “real-time” if it’s 1/day?
Scanning is scheduled once per day, but the UI updates live during the scan via SSE/WebSocket events (scan_finished, page_changed, uptime_up/down). You see results immediately when the scan completes.