# For domain: http://www.urgeartists.com # All robots will spider the domain User-agent: * Disallow: # Disallow directory /aspnet_client/ User-agent: * Disallow: /aspnet_client/ # Disallow directory /assets/ User-agent: * Disallow: /assets/ # Disallow directory /CGI-BIN/ User-agent: * Disallow: /CGI-BIN/ # Disallow directory /database/ User-agent: * Disallow: /database/ # Disallow directory /images/ User-agent: * Disallow: /images/ # Disallow directory /old-site-10-31-08/ User-agent: * Disallow: /old-site-10-31-08/