# 情报雷达 · AI 公开情报检索引擎(ZovaX 旗下) # 静态情报简报与产业专题对搜索引擎、合规 AI 爬虫开放;动态检索接口与 API 不开放抓取。 # 动态检索页另有 noindex:不靠 robots 单独解决 —— robots 管抓取,noindex 管收录。 # ── 通用爬虫:公开页可抓,动态检索与接口不抓 ── User-agent: * Allow: / Disallow: /search Disallow: /search? Disallow: /api/ Disallow: /admin Disallow: /download/ Disallow: /intel Disallow: /intel.html # ── 搜索引擎:全站静态页放行(首页要能爬,否则简报链接发现不了) ── User-agent: Googlebot Allow: / Disallow: /api/ Disallow: /admin Disallow: /download/ User-agent: Google-InspectionTool Allow: / Disallow: /api/ Disallow: /admin Disallow: /download/ User-agent: GoogleOther Allow: / Disallow: /api/ Disallow: /admin Disallow: /download/ User-agent: Bingbot Allow: / Disallow: /api/ Disallow: /admin Disallow: /download/ User-agent: Baiduspider Allow: / Disallow: /api/ Disallow: /admin Disallow: /download/ User-agent: YandexBot Allow: / Disallow: /api/ Disallow: /admin Disallow: /download/ User-agent: DuckDuckBot Allow: / Disallow: /api/ Disallow: /admin Disallow: /download/ User-agent: Bravebot Allow: / Disallow: /api/ Disallow: /admin Disallow: /download/ User-agent: Sogou Allow: / Disallow: /api/ Disallow: /admin Disallow: /download/ User-agent: 360Spider Allow: / Disallow: /api/ Disallow: /admin Disallow: /download/ User-agent: applebot Allow: / Disallow: /api/ Disallow: /admin Disallow: /download/ User-agent: PetalBot Allow: / Disallow: /api/ Disallow: /admin Disallow: /download/ # ── 合规大模型爬虫:只读公开静态情报,动态接口关闭 ── User-agent: GPTBot Allow: / Disallow: /api/ Disallow: /admin Disallow: /download/ Disallow: /search Disallow: /intel Disallow: /intel.html User-agent: OAI-SearchBot Allow: / Disallow: /api/ Disallow: /admin Disallow: /download/ Disallow: /search Disallow: /intel Disallow: /intel.html User-agent: ChatGPT-User Allow: / Disallow: /api/ Disallow: /admin Disallow: /download/ Disallow: /search Disallow: /intel Disallow: /intel.html User-agent: ClaudeBot Allow: / Disallow: /api/ Disallow: /admin Disallow: /download/ Disallow: /search Disallow: /intel Disallow: /intel.html User-agent: Claude-User Allow: / Disallow: /api/ Disallow: /admin Disallow: /download/ Disallow: /search Disallow: /intel Disallow: /intel.html User-agent: Claude-SearchBot Allow: / Disallow: /api/ Disallow: /admin Disallow: /download/ Disallow: /search Disallow: /intel Disallow: /intel.html User-agent: anthropic-ai Allow: / Disallow: /api/ Disallow: /admin Disallow: /download/ Disallow: /search Disallow: /intel Disallow: /intel.html User-agent: PerplexityBot Allow: / Disallow: /api/ Disallow: /admin Disallow: /download/ Disallow: /search Disallow: /intel Disallow: /intel.html User-agent: Perplexity-User Allow: / Disallow: /api/ Disallow: /admin Disallow: /download/ Disallow: /search Disallow: /intel Disallow: /intel.html User-agent: DeepSeekBot Allow: / Disallow: /api/ Disallow: /admin Disallow: /download/ Disallow: /search Disallow: /intel Disallow: /intel.html User-agent: DeepSeek-User Allow: / Disallow: /api/ Disallow: /admin Disallow: /download/ Disallow: /search Disallow: /intel Disallow: /intel.html User-agent: Applebot-Extended Allow: / Disallow: /api/ Disallow: /admin Disallow: /download/ Disallow: /search Disallow: /intel Disallow: /intel.html User-agent: meta-externalagent Allow: / Disallow: /api/ Disallow: /admin Disallow: /download/ Disallow: /search Disallow: /intel Disallow: /intel.html User-agent: cohere-ai Allow: / Disallow: /api/ Disallow: /admin Disallow: /download/ Disallow: /search Disallow: /intel Disallow: /intel.html User-agent: Amazonbot Allow: / Disallow: /api/ Disallow: /admin Disallow: /download/ Disallow: /search Disallow: /intel Disallow: /intel.html User-agent: YouBot Allow: / Disallow: /api/ Disallow: /admin Disallow: /download/ Disallow: /search Disallow: /intel Disallow: /intel.html # ── 垃圾采集 / SEO 农场:全站拦截 ── User-agent: SemrushBot Disallow: / User-agent: AhrefsBot Disallow: / User-agent: MJ12bot Disallow: / User-agent: DotBot Disallow: / User-agent: BLEXBot Disallow: / User-agent: rogerbot Disallow: / User-agent: DataForSeoBot Disallow: / User-agent: SerpstatBot Disallow: / User-agent: SEOdiver Disallow: / User-agent: Bytespider Disallow: / User-agent: Diffbot Disallow: / User-agent: Webzio-Extended Disallow: / User-agent: Zyte Disallow: / User-agent: Apify Disallow: / User-agent: Timpibot Disallow: / User-agent: Cocolyzebot Disallow: / Sitemap: https://intel.zovaxai.com/sitemap.xml