1 User-agent: *

     2 Disallow: /persistence/

     3 

     4 # Unseriöse Spider

     5 User-agent: WebReaper

     6 User-agent: WebCopier

     7 User-agent: Offline Explorer

     8 User-agent: HTTrack

     9 User-agent: Microsoft.URL.Control

    10 User-agent: EmailCollector

    11 User-agent: penthesilea

    12 User-agent: MJ12bot

    13 User-agent: AhrefsBot

    14 Disallow: /