User-agent: * Disallow: /site/ Disallow: /pdf/ Disallow: /images/ Disallow: /wholesale/ Disallow: /customerlogin.html