# This file is used to notify crawlers/spiders what files to avoid User-agent: * Disallow: /aspnet_client/ Disallow: /css/ Disallow: /flash/ Disallow: /js/ Disallow: /usercontrols/ Disallow: web.config