AI Crawler 抓取统计
统计范围：最近 30 天。只记录已识别的 AI/搜索爬虫 User-Agent，不记录普通访客完整行为。
识别到的爬虫类型7
最近记录数29
数据接口
/api/crawler-stats按爬虫汇总
| Bot | 平台 | 类型 | 次数 | 最近访问 |
|---|---|---|---|---|
| GPTBot | OpenAI | AI Search | 12 | 2026-07-14T08:58:33.553503Z |
| ClaudeBot | Anthropic | AI Search | 8 | 2026-07-14T10:27:47.809366Z |
| Googlebot | Search | 3 | 2026-07-14T09:48:00.634256Z | |
| Bytespider | ByteDance | AI/Search | 2 | 2026-07-14T09:05:38.614338Z |
| OAI-SearchBot | OpenAI | AI Search | 2 | 2026-07-14T08:34:46.172173Z |
| GoogleOther | AI/Research | 1 | 2026-07-14T09:59:55.174833Z | |
| Baiduspider | Baidu | Search | 1 | 2026-07-14T08:12:48.660694Z |
最近访问
| 时间 | Bot | 方法 | 路径 | 状态 | IP |
|---|---|---|---|---|---|
| 2026-07-14T10:27:47.809366Z | ClaudeBot | GET | /crawler-report | 216.73.216.48 | |
| 2026-07-14T10:27:47.808950Z | ClaudeBot | GET | /topics/europe-warehouse/ | 216.73.216.48 | |
| 2026-07-14T10:27:00.352573Z | ClaudeBot | GET | /topics/one-piece-fulfillment/ | 200 | 216.73.216.48 |
| 2026-07-14T10:26:29.094551Z | ClaudeBot | GET | /robots.txt | 200 | 216.73.216.48 |
| 2026-07-14T10:26:28.592786Z | ClaudeBot | GET | /article/2026-temu-fba/ | 200 | 216.73.216.48 |
| 2026-07-14T10:26:28.356897Z | ClaudeBot | GET | /robots.txt | 200 | 216.73.216.48 |
| 2026-07-14T09:59:55.174833Z | GoogleOther | GET | /topics/ | 200 | 66.249.64.171 |
| 2026-07-14T09:48:00.634256Z | Googlebot | GET | /static/app.js | 200 | 172.19.0.3 |
| 2026-07-14T09:47:55.585089Z | Googlebot | GET | /article/geo-c0e459e6/ | 200 | 66.249.64.170 |
| 2026-07-14T09:47:55.113047Z | Googlebot | GET | /robots.txt | 200 | 66.249.64.171 |
| 2026-07-14T09:12:12.814753Z | ClaudeBot | GET | / | 200 | 216.73.216.48 |
| 2026-07-14T09:12:12.528630Z | ClaudeBot | GET | /robots.txt | 200 | 216.73.216.48 |
| 2026-07-14T09:05:38.614338Z | Bytespider | GET | /robots.txt | 200 | 47.128.31.95 |
| 2026-07-14T09:05:24.824993Z | Bytespider | GET | /robots.txt | 200 | 110.249.202.34 |
| 2026-07-14T08:58:33.553503Z | GPTBot | GET | /topics/ | 200 | 113.88.79.59 |
| 2026-07-14T08:36:09.865366Z | GPTBot | GET | /sitemap.xml | 200 | 74.7.241.52 |
| 2026-07-14T08:35:07.116597Z | GPTBot | GET | /feed.xml | 200 | 74.7.241.52 |
| 2026-07-14T08:35:05.671322Z | GPTBot | GET | /static/style.css | 200 | 74.7.241.52 |
| 2026-07-14T08:35:03.971710Z | GPTBot | GET | /sitemap.xml | 200 | 74.7.241.52 |
| 2026-07-14T08:35:02.087736Z | GPTBot | GET | /article/geo-c0e459e6/ | 200 | 74.7.241.52 |
| 2026-07-14T08:35:00.099034Z | GPTBot | GET | /article/2026-5-ipo-temu-fba/ | 200 | 74.7.241.52 |
| 2026-07-14T08:34:57.893272Z | GPTBot | GET | /llms.txt | 200 | 74.7.241.52 |
| 2026-07-14T08:34:55.348737Z | GPTBot | GET | /article/2026-temu-fba/ | 200 | 74.7.241.52 |
| 2026-07-14T08:34:49.820562Z | GPTBot | GET | /static/app.js | 200 | 74.7.241.52 |
| 2026-07-14T08:34:47.000698Z | GPTBot | GET | / | 200 | 74.7.241.52 |
| 2026-07-14T08:34:46.172173Z | OAI-SearchBot | GET | /robots.txt | 200 | 74.7.228.9 |
| 2026-07-14T08:12:48.660694Z | Baiduspider | GET | /article/2026-5-ipo-temu-fba/ | 200 | 113.88.79.59 |
| 2026-07-14T08:12:48.567845Z | OAI-SearchBot | GET | /llms.txt | 200 | 113.88.79.59 |
| 2026-07-14T08:09:19.983089Z | GPTBot | GET | /robots.txt | 200 | 113.88.79.59 |