# All robots will spider the domain User-agent: * Disallow: # Disallow directory manage.pl User-agent: * Disallow: manage.pl