# Skip content dirs User-agent: * Disallow: /cgi-bin/ Disallow: /cache/ Disallow: /color/ Disallow: /css/ Disallow: /fonts/ Disallow: /images/ Disallow: /inc/ Disallow: /js/ Disallow: /lib/ Disallow: /nta/ Disallow: /scss/ Disallow: /uploads/ Disallow: /login Disallow: /logout Disallow: /imprint Disallow: /dataprivacy # Disallow sucking spiders User-agent: WebReaper User-agent: WebCopier User-agent: Offline Explorer User-agent: HTTrack User-agent: Microsoft.URL.Control User-agent: EmailCollector User-agent: penthesilea Disallow: /