User-agent: * Disallow: /wp-admin/ Allow: /sitemap.xml Disallow: /*beta* Disallow: /*?* Disallow: /*pdf* Disallow: /*test*