# Allow all robots to spider everything by disallowing nothing

User-agent: *
Disallow: /products.asp
Disallow: /categories.asp
Disallow: /proddetail.asp