# For production environment - allow more specific paths User-agent: * Disallow: /cgi-bin/ Disallow: /? Disallow: *?s= Disallow: *&s= Disallow: /search/ Disallow: /author/ Disallow: /users/ Disallow: */trackback Disallow: */feed Disallow: */rss Disallow: */embed Disallow: *utm*= Disallow: *openstat= # Allow Facebook crawlers to access blog content User-agent: facebookexternalhit Allow: /blog/ Sitemap: https://erbis.com/sitemap.xml Host: https://erbis.com/ Allow: */uploads Allow: /*/*.js Allow: /*/*.css