#Robots.txt file from http://www.pet2008.com,http://www.nbpets.com,http://www.nbpets.cn #All robots will spider the domain User-agent: * Disallow: /old-bak/ Disallow: /admin/ Disallow: /css/ Disallow: /js/ Disallow: /database/