User-agent: Mediapartners-Google Disallow: User-agent: * Disallow: Allow: / User-agent: NinjaBot Allow: / User-agent: Mediapartners-Google* Allow: / User-agent: Adsbot-Google Allow: / Sitemap: https://www.exampleprogram.com/feeds/posts/default?orderby=updated Sitemap: https://www.exampleprogram.com/atom.xml?redirect=false&start-index=1&max-results=500