public audit · 2026-08-28

nytimes.com D

47/100 agent-readiness

Check	Points	What we found
llms.txt	0/20	Missing — agents have no curated map of this site
llms-full.txt	0/5	Missing (optional, but valued by agents)
robots.txt / AI crawler policy	9/15	Blocks AI crawlers: GPTBot, ClaudeBot, Claude-User, Claude-SearchBot, anthropic-ai, PerplexityBot, Perplexity-User, Google-Extended, CCBot, Bytespider, OAI-SearchBot, ChatGPT-User, Applebot-Extended, meta-externalagent
Sitemap	0/8	Missing
Meta tags	8/8	Title ✓, description ✓, 5 og: tags
Structured data (JSON-LD)	10/10	2 JSON-LD block(s)
Content extractability	10/15	Text ratio 0.007, semantic HTML ✓
Response time	6/6	642 ms
Feeds	3/3	RSS/Atom advertised
Agent affordances (MCP, OpenAPI)	1/10	security.txt

Is your site better than this?

Probably not — most sites we scan score under 50. Find out, and get every fix shipped to you in 24h.