ChainCatcher 消息，研究机构 Shoal Research 发布报告称，Cloudflare 网络上机器人约占 HTML 内容 HTTP 请求的 60%，人类为 38.2%。Cloudflare CEO Matthew Prince 曾预测机器人流量将在 2027 年超过人类，随后宣布智能体流量增长已使机器人超过人类流量。
报告称，AI 应用将用户留在聊天界面并总结内容，而非导流回原站。AI 爬虫抓取与回访比例远高于 Googlebot，ClaudeBot 过去一年平均每回访一次抓取约 4200 页。Pew 研究显示，AI 摘要使点击率从 15% 降至 8%。
robots.txt 与内容换流量模式难以维持。诉讼与私人授权为权宜之计。按请求付费分为带密钥的封闭市场，以及使用 HTTP 402 和稳定币的开放协议如 x402 和 MPP。多数网站仍免费提供或屏蔽。
Disclaimer: Investing carries risk. This is not financial advice. The above content should not be regarded as an offer, recommendation, or solicitation on acquiring or disposing of any financial products, any associated discussions, comments, or posts by author or other users should not be considered as such either. It is solely for general information purpose only, which does not consider your own investment objectives, financial situations or needs. TTM assumes no responsibility or warranty for the accuracy and completeness of the information, investors should do their own research and may seek professional advice before investing.