User-agent: * Disallow: /includes/ # Disallow specific bots from indexing or crawling the site at all # Most recent additions first. User-agent: Yandex bot Disallow: /