# This allows the site to be spidered, but not the downloads directory User-agent: * Disallow: /