# Make changes for all web spiders : # User-agent: * and all folders: # Disallow: / User-agent: * Disallow: /system/ Allow: /