Overall Waterfall
Site-Wide Crawl Overview
Total crawl volume and unique URLs crawled across the entire Coupang TW domain, with key technical implementations marked.
Loading…
Total Crawls vs. Unique URLs Crawled
Raw crawl volume alongside distinct URLs visited each week
Total Crawls
Unique URLs
3P URLs Added to XML Sitemap (May 3)
URL Standardization (May 20)
Crawl Efficiency vs. Waste
% of crawled URLs that are valuable pages vs. API/noise
Page Type Breakdown
Products, nAPI, nextAPI, Categories weekly split
PID Total vs. PID In-Stock
Product identifier coverage — gap shows OOS/delisted products
PID Total
PID In-Stock
Product Waterfall
SDP Crawl Breakdown
Crawl behaviour across /products/ URLs — clean slugs, PID-only duplicates, parameter variants, and API hits within the product segment.
Loading…
Total SDP Crawls vs. Unique Product URLs
Total /products/ crawl volume and distinct product URLs visited per week
Total SDP Crawls
Unique Product URLs
3P URLs Added to XML Sitemap (May 3)
URL Standardization (May 20)
Clean SDPs vs. PID-Only Duplicates
Slug+PID clean URLs vs. numeric-only PID duplicate pages
Parameterised URL Mix
itemId/vendorItemId, categoryId, searchId, traceId within product segment
Product Crawl Efficiency vs. Waste
Rising efficiency = URL standardisation working. Falling waste = less crawl budget on junk URLs.
Efficiency %
Waste %
3P URLs Added to XML Sitemap (May 3)
URL Standardization (May 20)
Clean URL Waterfall
Parameter-Free Crawl Health
Only URLs without query strings — a proxy for Googlebot hitting canonical, indexable URLs. Tracks how well the clean URL surface is explored vs. parameter-polluted variants.
Loading…
Total Clean Crawls vs. Unique Clean URLs
All domain crawls where the URL contains no "?" — directly comparable to what Google would index
Total Clean Crawls
Unique Clean URLs
3P URLs Added to XML Sitemap (May 3)
URL Standardization (May 20)
Clean SDPs vs. PID-Only Duplicates
Clean product pages vs. numeric-only PID duplicates in clean segment
Next-API Crawls in Clean Segment
API URLs crawled without parameters — should trend to zero post-standardisation
Clean Categories, SRPs & Campaigns
Indexable pages by type in the clean segment
Categories
SRPs
Campaigns