onsombleai
OverviewSee how it all fits together
Answer Engine OptimisationTrack how your brand shows up in AI answers
For AgenciesTrack client brands across every AI engine
For BusinessSee how AI talks about your brand
Pricing
BlogLatest news and insights
GuidesStep-by-step tutorials
DocsProduct docs and API reference
AI-Powered ToolsFree utilities to enhance your AI workflow.
Learn more
Sign InRun a free scan
onsombleai

See how AI talks about your business.
Then make it work for you.

Company

  • About
  • Careers
  • Contact Us
  • FAQ

Product

  • Docs
  • Blog
  • Pricing
  • Changelog

Features

  • AI Radar
  • AI Glossary
  • Guide

Partnership

  • Agencies
  • Creators
  • Media

News

  • Latest Posts
  • Tools
  • Docs

Follow Us

  • x.com
  • LinkedIn

© 2026 Onsomble LTD. All rights reserved.

Cookie SettingsPrivacy PolicyTerms of ServiceAttributionsImprint
onsombleai
OverviewSee how it all fits together
Answer Engine OptimisationTrack how your brand shows up in AI answers
For AgenciesTrack client brands across every AI engine
For BusinessSee how AI talks about your brand
Pricing
BlogLatest news and insights
GuidesStep-by-step tutorials
DocsProduct docs and API reference
AI-Powered ToolsFree utilities to enhance your AI workflow.
Learn more
Sign InRun a free scan
onsombleai

See how AI talks about your business.
Then make it work for you.

Company

  • About
  • Careers
  • Contact Us
  • FAQ

Product

  • Docs
  • Blog
  • Pricing
  • Changelog

Features

  • AI Radar
  • AI Glossary
  • Guide

Partnership

  • Agencies
  • Creators
  • Media

News

  • Latest Posts
  • Tools
  • Docs

Follow Us

  • x.com
  • LinkedIn

© 2026 Onsomble LTD. All rights reserved.

Cookie SettingsPrivacy PolicyTerms of ServiceAttributionsImprint
Onsomble Blog

AI visibility, answer engines, and the future of brand discovery.

Insights on AEO strategy, AI-powered search, and how brands stay visible when answers replace links.

All posts
Strategy
Workflows
Engineering
AEO
Comparison11 min read

ClaudeBot vs Claude-SearchBot: How to Control Anthropic Crawlers

ClaudeBot collects public-web content that may contribute to model training, Claude-SearchBot supports search indexing, and Claude-User retrieves pages for user questions. Each identity requires separate robots.txt and Crawl-delay decisions.

Rosh Jayawardena
Rosh Jayawardena
Aug 7, 2026
How To11 min read

Is Your Website Blocking ChatGPT, Claude, and Perplexity?

Most robots.txt guides for AI crawlers are written for publishers who want to block the bots. This is the opposite: how to check if your site is accidentally invisible to ChatGPT, Claude and Perplexity — and the exact lines to paste to fix it.

Rosh Jayawardena
Rosh Jayawardena
May 6, 2026