# Custom Crawl Rules & Exclusions User-agent: meta-externalagent Disallow: /news/ Disallow: /news-and-events/ User-agent: Baiduspider Disallow: /news/ Disallow: /news-and-events/ # Standard WordPress Exclusions & Rate Management User-agent: * Crawl-delay: 10 Disallow: /?s= Disallow: /page/*/?s= Disallow: /search/ Disallow: /wp-json/ Disallow: /?rest_route= # XML Sitemap Location Sitemap: https://uscdcb.com/sitemap_index.xml