User-agent: * Disallow: /categories/add/ Disallow: /admin/ Disallow: /deals/index/ Disallow: /deals/add/ Disallow: /tracktweets/ Disallow: /deals/tweetmsg/ Disallow: /deals/edit/ Allow: / Disallow: /categories/edit/ Disallow: /categories/index/