User-agent: *
Allow: *
User-agent: NPBot
Disallow: /
User-agent: Tutorial Crawler
Disallow: /
User-agent: Xenu Link Sleuth
Disallow: /
User-agent: semanticdiscovery
Disallow: /