# Allow most, block these dirs User-agent: * Disallow: /assets/ Disallow: /config/ Disallow: /images/ Disallow: /manage/ #STOP THESE BOTS User-agent: AhrefsBot User-agent: MJ12bot User-agent: Baiduspider User-agent: Ezooms User-agent: YandexBot Disallow: /