User-agent: *
Crawl-delay: 5

User-Agent: *
Disallow: /Transfers/
Disallow: /passwd/

User-agent: Yandex
Disallow: /