# For domain: http://www.auroraprovisions.com/ # All robots will spider the domain User-agent: * Disallow: # Disallow directory cgibin/ User-agent: * Disallow: cgibin/