User-agent: * Allow: / Crawl-delay:3 Disallow: /dev