User-agent: AhrefsSiteAudit Disallow: / User-agent: * Crawl-delay: 30 Disallow: /wp-admin/ Disallow: /wp-includes/ Disallow: /trackback/ Disallow: /feed/ Disallow: /comments/ Disallow: */trackback/ Disallow: */feed/ Disallow: */comments/ Disallow: /wp-register.php Disallow: /wp-login.php Disallow: /wp-content/plugins/ Allow: /wp-content/ Allow: /wp-content/* Allow: /wp-includes/*.js* Sitemap: https://www.phi24.de/sitemap_index.xml