AI Readiness Report

robots.txt reachable.

The following AI crawlers are currently blocked by robots.txt: GPTBot, ClaudeBot, Google-Extended, Bytespider, PerplexityBot, KimiBot. This reduces visibility in AI search and agent discovery.

1. Edit the root robots.txt file and add Allow rules for the AI crawlers below.
2. If you need to protect specific paths (e.g. admin panels), use precise Disallow rules inside the wildcard group.
3. Add a Sitemap reference: Sitemap: https://techcrunch.com/sitemap.xml.
4. Re-run the analysis after deployment to confirm the status changes to Allowed.

User-agent: GPTBot
Allow: /

User-agent: ClaudeBot
Allow: /

User-agent: Google-Extended
Allow: /

User-agent: Bytespider
Allow: /

User-agent: PerplexityBot
Allow: /

User-agent: KimiBot
Allow: /

User-agent: *
Allow: /

sitemap.xml declared.

No automated fix snippet for this item — address it directly, or see Actionable Recommendations.

GPTBot disallowed / not declared.

The following AI crawlers are currently blocked by robots.txt: GPTBot, ClaudeBot, Google-Extended, Bytespider, PerplexityBot, KimiBot. This reduces visibility in AI search and agent discovery.

1. Edit the root robots.txt file and add Allow rules for the AI crawlers below.
2. If you need to protect specific paths (e.g. admin panels), use precise Disallow rules inside the wildcard group.
3. Add a Sitemap reference: Sitemap: https://techcrunch.com/sitemap.xml.
4. Re-run the analysis after deployment to confirm the status changes to Allowed.

User-agent: GPTBot
Allow: /

User-agent: ClaudeBot
Allow: /

User-agent: Google-Extended
Allow: /

User-agent: Bytespider
Allow: /

User-agent: PerplexityBot
Allow: /

User-agent: KimiBot
Allow: /

User-agent: *
Allow: /

ClaudeBot disallowed / not declared.

The following AI crawlers are currently blocked by robots.txt: GPTBot, ClaudeBot, Google-Extended, Bytespider, PerplexityBot, KimiBot. This reduces visibility in AI search and agent discovery.

1. Edit the root robots.txt file and add Allow rules for the AI crawlers below.
2. If you need to protect specific paths (e.g. admin panels), use precise Disallow rules inside the wildcard group.
3. Add a Sitemap reference: Sitemap: https://techcrunch.com/sitemap.xml.
4. Re-run the analysis after deployment to confirm the status changes to Allowed.

User-agent: GPTBot
Allow: /

User-agent: ClaudeBot
Allow: /

User-agent: Google-Extended
Allow: /

User-agent: Bytespider
Allow: /

User-agent: PerplexityBot
Allow: /

User-agent: KimiBot
Allow: /

User-agent: *
Allow: /

Google-Extended disallowed / not declared.

The following AI crawlers are currently blocked by robots.txt: GPTBot, ClaudeBot, Google-Extended, Bytespider, PerplexityBot, KimiBot. This reduces visibility in AI search and agent discovery.

1. Edit the root robots.txt file and add Allow rules for the AI crawlers below.
2. If you need to protect specific paths (e.g. admin panels), use precise Disallow rules inside the wildcard group.
3. Add a Sitemap reference: Sitemap: https://techcrunch.com/sitemap.xml.
4. Re-run the analysis after deployment to confirm the status changes to Allowed.

User-agent: GPTBot
Allow: /

User-agent: ClaudeBot
Allow: /

User-agent: Google-Extended
Allow: /

User-agent: Bytespider
Allow: /

User-agent: PerplexityBot
Allow: /

User-agent: KimiBot
Allow: /

User-agent: *
Allow: /

Bytespider disallowed / not declared.

The following AI crawlers are currently blocked by robots.txt: GPTBot, ClaudeBot, Google-Extended, Bytespider, PerplexityBot, KimiBot. This reduces visibility in AI search and agent discovery.

1. Edit the root robots.txt file and add Allow rules for the AI crawlers below.
2. If you need to protect specific paths (e.g. admin panels), use precise Disallow rules inside the wildcard group.
3. Add a Sitemap reference: Sitemap: https://techcrunch.com/sitemap.xml.
4. Re-run the analysis after deployment to confirm the status changes to Allowed.

User-agent: GPTBot
Allow: /

User-agent: ClaudeBot
Allow: /

User-agent: Google-Extended
Allow: /

User-agent: Bytespider
Allow: /

User-agent: PerplexityBot
Allow: /

User-agent: KimiBot
Allow: /

User-agent: *
Allow: /

KimiBot disallowed / not declared.

The following AI crawlers are currently blocked by robots.txt: GPTBot, ClaudeBot, Google-Extended, Bytespider, PerplexityBot, KimiBot. This reduces visibility in AI search and agent discovery.

1. Edit the root robots.txt file and add Allow rules for the AI crawlers below.
2. If you need to protect specific paths (e.g. admin panels), use precise Disallow rules inside the wildcard group.
3. Add a Sitemap reference: Sitemap: https://techcrunch.com/sitemap.xml.
4. Re-run the analysis after deployment to confirm the status changes to Allowed.

User-agent: GPTBot
Allow: /

User-agent: ClaudeBot
Allow: /

User-agent: Google-Extended
Allow: /

User-agent: Bytespider
Allow: /

User-agent: PerplexityBot
Allow: /

User-agent: KimiBot
Allow: /

User-agent: *
Allow: /

Organization schema with name + url.

No automated fix snippet for this item — address it directly, or see Actionable Recommendations.

No Product schema.

No Product schema was detected. E-commerce or product content cannot be recognised and cited by AI as a structured entity, which costs you rich-result placement.

1. Add the Product JSON-LD below to each product detail page.
2. Replace name, image, price and brand with real values (price must be a numeric string).
3. Use ItemList to aggregate multiple products on listing pages.

<script type="application/ld+json">
{
  "@context": "https://schema.org",
  "@type": "Product",
  "name": "TechCrunch | Startup and Technology News Product Name",
  "image": ["https://techcrunch.com/wp-content/uploads/2024/09/tc-logo-mobile.svg"],
  "description": "Brief product description",
  "brand": { "@type": "Brand", "name": "TechCrunch | Startup and Technology News" },
  "offers": { "@type": "Offer", "priceCurrency": "USD", "price": "0" }
}
</script>

No FAQPage schema.

No FAQPage schema was detected. Common questions and answers cannot be cited directly by AI as authoritative answers, and you miss rich-result opportunities.

1. Add the FAQPage JSON-LD below to your FAQ page.
2. Make sure the question/answer text matches the visible page content exactly.

<script type="application/ld+json">
{
  "@context": "https://schema.org",
  "@type": "FAQPage",
  "mainEntity": [{
    "@type": "Question",
    "name": "Your first question?",
    "acceptedAnswer": { "@type": "Answer", "text": "The authoritative answer." }
  }]
}
</script>

No Article schema.

No Article schema was detected. Editorial content is less likely to be treated as an authoritative source by AI, and you miss rich-result placement.

1. Add the Article JSON-LD below to each article page.
2. Ensure author, publisher and datePublished match the visible content.

<script type="application/ld+json">
{
  "@context": "https://schema.org",
  "@type": "Article",
  "headline": "Article title",
  "author": { "@type": "Person", "name": "Author name" },
  "publisher": { "@type": "Organization", "name": "TechCrunch | Startup and Technology News" },
  "datePublished": "2026-01-01",
  "dateModified": "2026-01-01"
}
</script>

Breadcrumb schema present.

No automated fix snippet for this item — address it directly, or see Actionable Recommendations.

Entity fields covered: 3/11.

Brand entity coverage is insufficient. AI cannot build a complete entity profile (description, contact details, industry, sameAs social links, etc.), lowering the chance of accurate citations.

1. Extend your Organization / WebSite schema with description, telephone, email, address, industry, founder and foundingDate.
2. Link official social profiles, Wikipedia or other authoritative pages via sameAs.
3. Keep the brand name and logo consistent across all pages.

Homepage content depth: 5/5.

No automated fix snippet for this item — address it directly, or see Actionable Recommendations.

About page reachable.

No automated fix snippet for this item — address it directly, or see Actionable Recommendations.

No Product page found.

No automated fix snippet for this item — address it directly, or see Actionable Recommendations.

No FAQ page found.

No automated fix snippet for this item — address it directly, or see Actionable Recommendations.

No Blog / Case page found.

No automated fix snippet for this item — address it directly, or see Actionable Recommendations.

Rich topical content detected.

No automated fix snippet for this item — address it directly, or see Actionable Recommendations.

No blog or case section found.

No automated fix snippet for this item — address it directly, or see Actionable Recommendations.

Author / byline information present.

No automated fix snippet for this item — address it directly, or see Actionable Recommendations.

Brand entity consistent across pages.

No automated fix snippet for this item — address it directly, or see Actionable Recommendations.

Few external trust signals.

No automated fix snippet for this item — address it directly, or see Actionable Recommendations.

No OpenAPI descriptor detected.

No OpenAPI / Swagger descriptor was detected. AI agents cannot auto-discover or invoke your API, which means you miss tool-integration opportunities.

1. Serve the OpenAPI 3.0 manifest below at /openapi.json.
2. Fill in your real paths, component schemas and authentication method.
3. Link to the descriptor from your homepage or developer docs.

{
  "openapi": "3.0.3",
  "info": {
    "title": "TechCrunch | Startup and Technology News API",
    "version": "1.0.0",
    "description": "Machine-readable API for TechCrunch | Startup and Technology News"
  },
  "servers": [{ "url": "https://techcrunch.com/api" }],
  "paths": {
    "/health": {
      "get": {
        "summary": "Service health",
        "responses": { "200": { "description": "OK" } }
      }
    }
  }
}

No Model Context Protocol endpoint found.

No Model Context Protocol (MCP) endpoint was detected. AI agents cannot tool-enable your service through tools or resources without it.

1. Serve the manifest below at /.well-known/mcp.json.
2. Implement the corresponding MCP server (tools and resources).
3. Document the integration path in your developer docs.

{
  "protocolVersion": "2024-11-05",
  "serverInfo": { "name": "TechCrunch | Startup and Technology News", "version": "1.0.0" },
  "capabilities": { "tools": {} },
  "endpoints": { "base": "https://techcrunch.com/mcp" }
}

No AI Actions manifest detected.

No automated fix snippet for this item — address it directly, or see Actionable Recommendations.

API / developer documentation linked.

No automated fix snippet for this item — address it directly, or see Actionable Recommendations.

Served over HTTPS.

No automated fix snippet for this item — address it directly, or see Actionable Recommendations.

Business contact visible.

No automated fix snippet for this item — address it directly, or see Actionable Recommendations.

HTTP status 200.

No automated fix snippet for this item — address it directly, or see Actionable Recommendations.