#deny all spider user-agent: * disallow: /dl/ disallow: /ms/ disallow: /edm/ disallow: /demo/ disallow: /cust/ disallow: /clients/ disallow: /hv/ disallow: /pino/