Rattlesnakes By Mail

Daily snapshot 2026-11-12

2026-11-12 UTC

The numbers come from one website. They describe what these crawlers did here, not across the web.

Period: 2026-11-12T00:00:00Z to 2026-11-13T00:00:00Z (00:00Z to 24:00Z). Generated 2026-11-13T03:18:40.235Z. Schema version 1. Licence CC BY 4.0. Cite as: Benes, Peter. Rattlesnakes By Mail: A Field Guide to the Crawlers of the Web. benesthemenace.com. Method: https://rattlesnakesbymail.com/method

Requests by crawler on 2026-11-12Requests on 2026-11-12 by crawler, against each crawler's 28-day median. ClaudeBot: 68 requests, 28-day median 48; Googlebot: 56 requests, 28-day median 32; Bingbot: 48 requests, 28-day median 28; ChatGPT-User: 8 requests, 28-day median 0; GPTBot: 4 requests, 28-day median 4; OAI-SearchBot: 3 requests, 28-day median 6; Reflectionbot: 2 requests, 28-day median 0.ClaudeBotClaudeBot: 68 requests28-day median 4868GooglebotGooglebot: 56 requests28-day median 3256BingbotBingbot: 48 requests28-day median 2848ChatGPT-UserChatGPT-User: 8 requests8GPTBotGPTBot: 4 requests28-day median 44OAI-SearchBotOAI-SearchBot: 3 requests28-day median 63ReflectionbotReflectionbot: 2 requests2
Bars show requests on 2026-11-12. The black tick on each row marks that crawler's 28-day median.

Facts

This selection has expired; it is listed in snapshot.json.

Crawlers

CrawlerRequestsVerified shareDistinct paths28-day medianSweep dayFirst pathrobots.txtsitemap
ClaudeBot68100%448no/sitemap.xml1454
Googlebot5685.7%3332no/robots.txt170
Bingbot48100%3128no/compare/applebot-vs-googlebot.json01
ChatGPT-User80%70no/.env.backup00
GPTBot4100%44no/sitemap-index.xml03
OAI-SearchBot3100%26no/robots.txt20
Reflectionbot2100%20no/robots.txt10

MCP calls

ClientToolCalls
mcplist_changes3
mcpget_snapshot1
mcpidentify_user_agent1
mcplookup_crawler1
mcp-discovery-measurementlist_changes1
mcp-index__mcp_index_nonexistent__1
rokmcp-probelist_changes1
verifymcp-probe__verifymcp_auth_probe_c52c312720726de3__1

Snapshot pickup

For each of the previous seven snapshots, the first fetch by each verified crawler, in minutes after publication, and the c tag on that fetch.

SnapshotCrawlerMinutes after publicationTag
2026-11-11Bingbot294none
2026-11-10Bingbot294none
2026-11-10ClaudeBot1,178none
2026-11-09Bingbot295none
2026-11-09Googlebot568none
2026-11-09GoogleOther568f
2026-11-09ClaudeBot2,670none
2026-11-08Bingbot297none
2026-11-08Googlebot1,977none
2026-11-08GoogleOther1,987f
2026-11-08ClaudeBot4,161none
2026-11-07Googlebot3,090none
2026-11-07GoogleOther3,384f
2026-11-07ClaudeBot5,642none
2026-11-07Bingbot6,428none
2026-11-06Bingbot293none
2026-11-06Googlebot294none
2026-11-06GoogleOther294h
2026-11-06ClaudeBot7,132none
2026-11-05Bingbot295none
2026-11-05Googlebot448none
2026-11-05GoogleOther581none
2026-11-05ClaudeBot8,609none

Open questions

If you can answer one of these with a source, send a note: POST https://rattlesnakesbymail.com/notes with target question:<id>, where <id> is the number shown with the question, and body=<your answer and its source>.

Ask for something this snapshot lacks

What data about web crawlers did you look for and not find? Search https://rattlesnakesbymail.com/search?q=your+question. Searches with no match are recorded as gaps. A gap is published at /questions only when an editor publishes it; nothing is published automatically. To suggest something this daily snapshot should include, send a note with target snapshot:261112.

To send it, POST https://rattlesnakesbymail.com/notes as a web form or as JSON with target=snapshot:261112 and body=<your note>. The same note can be sent with target_type=snapshot and target_id=261112. The optional author_claim field says who is writing: a person, a model or an agent.

Links

Next snapshot: 2026-11-13