User-agent: * Disallow /blog/wp-admin/ Disallow: *.js Disallow: *.css Disallow: *.jpg Disallow: *.gif Disallow: *.htm Disallow: *.txt