{"id":2625396,"recorded_at":"2026-11-03T18:34:53.994691Z","observed_at":"2026-11-03T18:34:53.994650Z","subject_kind":"endpoint","subject":"1a8a21b9-b430-4a5d-a6bf-117d8304d692","kind":"mcp.tools","method":"probe.mcp/1","body":{"count":3,"tools":[{"description":"Use when the user asks whether their site (or any public site) blocks ChatGPT, Claude, Google AI, Perplexity or other AI crawlers, whether AI can read or train on their content, or why AI search does not mention their site. Fetches the live robots.txt and reports, for 22 named AI bots in four groups (AI training, AI search, assistants, search engines), which are let in, kept out or partly blocked, plus the site's content-signal preference and fixes. Example: {\"url\": \"example.com\"}. Read-only. To write a new robots.txt use doorman_write_robots_txt.","inputSchema":{"properties":{"url":{"description":"Website address or domain, e.g. nytimes.com","type":"string"}},"required":["url"],"type":"object"},"name":"doorman_check_ai_bot_access"},{"description":"Use when the user pastes the text of a robots.txt (or you have drafted one) and asks which AI bots it lets in or blocks, or whether a change does what they want. Parses it the way crawlers do (groups, wildcards, longest-match) and reports each of 22 named AI bots as let in, kept out or partly blocked, with notes and a suggested choice. Pure parsing, no network. Example: {\"robots_txt\": \"User-agent: GPTBot\\nDisallow: /\"}.","inputSchema":{"properties":{"robots_txt":{"description":"The full robots.txt text (up to 512 KB). Empty means no robots.txt.","minLength":0,"type":"string"}},"required":["robots_txt"],"type":"object"},"name":"doorman_check_robots_txt"},{"description":"Use when the user wants to allow or block AI training, AI search or assistant bots on their site and needs the robots.txt lines. Takes an optional existing robots.txt plus a choice of \"in\" or \"out\" for each of three groups (training, ai_search, assistants) and returns a complete robots.txt that keeps existing rules, adds one clean group per choice and a shared content-signal line. Example: {\"training\": \"out\", \"ai_search\": \"in\", \"assistants\": \"in\"}. Returns text to paste at /robots.txt; it does not change any site.","inputSchema":{"properties":{"ai_search":{"description":"AI search and answer engines (default in).","enum":["in","out"],"type":"string"},"assistants":{"description":"Assistants that open a page because a person asked (default in).","enum":["in","out"],"type":"string"},"robots_txt":{"description":"Current robots.txt text to keep (optional).","type":"string"},"training":{"description":"Let AI training bots in or keep them out (default out).","enum":["in","out"],"type":"string"}},"type":"object"},"name":"doorman_write_robots_txt"}]},"body_sha256":"814ec7a976aee3a326874ddb6e1223d875f557bc284985b52baff2498d68aea5","prev_id":null,"leaf":"0xb5484f3953873667bf671ca558bea5bb42485ee79f1ff229592dd6f1826362d4","leaf_text":"{\"body\":\"814ec7a976aee3a326874ddb6e1223d875f557bc284985b52baff2498d68aea5\",\"id\":2625396,\"kind\":\"mcp.tools\",\"method\":\"probe.mcp/1\",\"observed_us\":1793730893994650,\"prev\":null,\"subject\":\"1a8a21b9-b430-4a5d-a6bf-117d8304d692\",\"subject_kind\":\"endpoint\"}","day":{"day":"2026-11-03","leaves":425475,"root":"0xb646ffa569e24bf8336b0a15a9d98d0a2f1239f58e10c2b18a9d22e43343566a","chained":"0x35e926359fd19031c6b5e08fb3b44f2524386a57c8fdd353336c185603f53d43","anchor_chain":"eip155:5042002","anchor_tx":"0xa5f9dadba13cde129126b950e64b815e6833cb8ff53b75026c9dbe769c3768c7","anchor_block":70601990},"proof":["0xb5486d62fc3ecfdbb36119d68b04d0c5ea4acc3aeea10776a59603ffe7349a59","0xeb100a1d0490048c36077f71a2d0851d9fadb371a98bfcbb681678af5271eae0","0x1ff74db4741b0de5c0158ae1405fa85cffe93abcde88132246d16e4e39b4bdc5","0xfc94a22341cfc9f078e5ca9c2f9ddbe66bee533d8fb44aec7bf37c47076bcbb7","0xfb9d3b963bdfffdd56c3256fe30d57677b1f5adad0a06db7b3f124fc22a88407","0x4c7f274ca47078eeb6eee2f8097de9caf5c744b22d7ca93070fb4e6218a6cf1d","0x0265536fc780b4664fece6d980cfd22a1d3cc325b21018fa1b54a88011dfd4ca","0xb6be8d157a5d29c9201c3186527501c6bf3da64ba252cc96f676f3afa39ef70e","0x0291577c9ff75941a8a267e40532175b9838018773646daf5504c8000dec5fb0","0x46db66dddb54248bf1df9453bb49c748b6e3c5df949fe503988563036d310021","0xa59787392fde5bafed06ee7828fafb8d0a8443b6f13f5da5f4099aa3599191c5","0x9a35904e1bb8077b8807427d95dec8c0d4862d485ff7683340c19f2f649e541f","0x21bb4f528bdd235a77e2f1802b439572aadfc1f1e65d2605dfa0bdcb481e4d28","0x1114468556630d3a65d038b1ce5fa0e558d58422878e6b91ce8c3b87e06fafef","0xc0bea6c8a0da854513562c1be034edd9e23999e98182b784da3cae0bf2e3890b","0xf8c1a0cdf4ba2eb105bc3e83d2f2b121cab4a34fb5a3846fa592909906f7fdaa","0x39dab39081985bbfffe23b080399a9d1a9cb9c2c8960102350c4212113cb2cba","0xac5402954216dc6c7020a6405675c8fc3b0828c2ab02943d80de52677a2f1fc3","0x85f3a27c16056a361d9ba33355a575ca7123f86de901b204c88953c4b8ea441a"]}