Keep HTML documents under crawl limits

Googlebot has a documented crawl size limit of approximately 15MB per HTML document. Content beyond this threshold is not parsed or indexed. Excessively large HTML also slows Googlebot crawls, reducing how many of your pages are crawled per budget period.

Quick Reference

• Googlebot stops parsing HTML beyond approximately 15MB; content after that point is not indexed
• Large HTML is usually caused by inline JSON data dumps, excessive inline SVG, or unminified JavaScript in <script> tags
• Target HTML document size under 2MB for optimal crawl efficiency; investigate anything over 5MB

Check

Measure the raw HTML response size (before compression) for each page. Flag pages over 2MB (investigate) and over 5MB (critical). Identify the cause of oversized HTML: (1) Large inline JSON (<script id='__NEXT_DATA__'> or similar). (2) Inline SVG files. (3) Base64-encoded images in HTML. (4) Inline CSS with large amounts of utility classes. (5) Unminified scripts in <script> tags.

Fix