{"id":998,"date":"2009-05-10T21:16:39","date_gmt":"2009-05-10T13:16:39","guid":{"rendered":"https:\/\/www.wopus.org\/blog-article\/seo-blog-article\/998.html"},"modified":"2009-05-10T21:16:39","modified_gmt":"2009-05-10T13:16:39","slug":"wordpress%e6%90%9c%e7%b4%a2%e5%bc%95%e6%93%8e%e4%bc%98%e5%8c%96%e4%b9%8brobotstxt%e4%bc%98%e5%8c%96","status":"publish","type":"post","link":"https:\/\/wopus.org\/?p=998","title":{"rendered":"WordPress\u641c\u7d22\u5f15\u64ce\u4f18\u5316\u4e4brobots.txt\u4f18\u5316"},"content":{"rendered":"<p>WordPress \u81ea\u4ece2.1\u7248\u672c\u5f00\u59cb\uff0c\u5728 Privacy \u9009\u9879\u91cc\u9762\u5141\u8bb8\u7528\u6237\u8bbe\u7f6e\u662f\u5426\u88ab\u641c\u7d22\u5f15\u64ce\u7d22\u5f15\u3002\u4f46\u662f\u5b83\u53ea\u67092\u4e2a\u9009\u9879\uff0c\u4e00\u4e2a\u662f\u5141\u8bb8\u6240\u6709\u641c\u7d22\u5f15\u64ce\u7684\u673a\u5668\u4eba\uff08Spider\uff09\u7d22\u5f15\u6240\u6709\u5185\u5bb9\uff0c\u53e6\u5916\u4e00\u4e2a\u5c31\u662f\u4e0d\u5141\u8bb8\u3002\u5176\u5b9e<strong>robots.txt<\/strong>\u7684\u7528\u6cd5\u6709\u5f88\u591a\uff0c\u6211\u4eec\u53ef\u4ee5\u901a\u8fc7\u5b83\u6765\u544a\u8bc9\u641c\u7d22\u5f15\u64ce\u90a3\u4e9b\u76ee\u5f55\u53ef\u4ee5\u722c\uff0c\u54ea\u4e9b\u4e0d\u53ef\u4ee5\u722c\u3002<\/p>\n<p>\u5728WordPress\u4e2d\u963b\u6b62Spider\u722c\u884c\u4e00\u4e9b\u76ee\u5f55\u548c\u6587\u4ef6\uff0c\u4e0d\u4f46\u53ef\u4ee5\u6709\u6548\u7684\u8282\u7701\u641c\u7d22\u5f15\u64ce\u5bf9\u670d\u52a1\u5668\u5e26\u5bbd\u7684\u5360\u7528\uff0c\u8fd8\u53ef\u4ee5\u63d0\u9ad8\u7f51\u7ad9\u5728\u641c\u7d22\u5f15\u64ce\u4e2d\u7684\u6392\u540d\u3002<\/p>\n<p>\u4f7f\u7528WordPress\u642d\u5efa\u7684\u535a\u5ba2\uff0c\u5229\u7528robots.txt\u6587\u4ef6\u9650\u5236\u641c\u7d22\u5f15\u64ce\u6293\u53d6\u90e8\u5206\u76ee\u5f55\u53ca\u6587\u4ef6\uff0c\u5f52\u7eb3\u5927\u81f4\u6709\u4ee5\u4e0b\u51e0\u79cd\u65b9\u6cd5\u3002<\/p>\n<p><strong>\u6700\u7b80\u5355\u7684\u5f00\u653e\u5199\u6cd5<\/strong>\uff1a<\/p>\n<blockquote><p>User-agent: *<br \/>\nDisallow:<\/p><\/blockquote>\n<p><strong>\u4f7f\u7528\u8bf4\u660e<\/strong>\uff1a\u5141\u8bb8\u6240\u6709\u8718\u86db\u8bbf\u95ee\uff0c\u5141\u8bb8\u8bbf\u95ee\u6240\u6709\u5185\u5bb9\u3002Wordpress\u53ea\u8981\u6a21\u677f\u4e2d\u94fe\u63a5\u8bbe\u8ba1\u5408\u7406\uff0c\u6ca1\u6709\u9700\u8981\u9650\u5236\u7684\u7279\u6b8a\u5185\u5bb9\uff0c\u63a8\u8350\u4f7f\u7528\u8fd9\u79cd\u5199\u6cd5\u3002<\/p>\n<p><strong>\u6700\u7b80\u5355\u7684\u4e25\u683c\u5199\u6cd5<\/strong>\uff1a<\/p>\n<blockquote><p>User-agent: *<br \/>\nDisallow: \/wp-*<br \/>\n#Allow: \/wp-content\/uploads\/<br \/>\nDisallow: \/*.php$<br \/>\nDisallow: \/*.inc$<br \/>\nDisallow: \/*.js$<br \/>\nDisallow: \/*.css$<br \/>\nDisallow: \/?s=<\/p><\/blockquote>\n<p><strong>\u4f7f\u7528\u8bf4\u660e<\/strong>\uff1a\u5141\u8bb8\u6240\u6709\u8718\u86db\u8bbf\u95ee\uff0c\u9650\u5236\u4ee5\u201cwp-\u201d\u5f00\u5934\u7684\u76ee\u5f55\u53ca\u6587\u4ef6\uff0c\u9650\u5236\u6293\u53d6.php\u6587\u4ef6\u3001.inc\u6587\u4ef6\u3001.js\u6587\u4ef6\u3001.css\u6587\u4ef6\uff0c\u9650\u5236\u6293\u53d6\u641c\u7d22\u7ed3\u679c\u3002<\/p>\n<p>Disallow: \/wp-* \u4f1a\u8fde\u540c\u9644\u4ef6\u76ee\u5f55\u4e00\u8d77\u9650\u5236\u6293\u53d6\uff0c\u5982\u679c\u60f3\u8ba9\u641c\u7d22\u5f15\u64ce\u6293\u53d6\u9644\u4ef6\u4e2d\u7684\u5185\u5bb9\uff0c\u5c06\u7b2c\u4e09\u884c\u7684 # \u53f7\u6ce8\u91ca\u53bb\u6389\u3002Allow \u4e0d\u662f\u6240\u6709\u641c\u7d22\u5f15\u64ce\u90fd\u652f\u6301\u3002<\/p>\n<p><strong>\u6700\u5408\u7406\u7684\u5199\u6cd5<\/strong>\uff1a<\/p>\n<blockquote><p>User-agent: *<br \/>\nDisallow: \/wp-admin<br \/>\nDisallow: \/wp-content\/plugins<br \/>\nDisallow: \/wp-content\/themes<br \/>\nDisallow: \/wp-includes<br \/>\nDisallow: \/?s=<br \/>\nSitemap: http:\/\/domain\/sitemap.xml<\/p><\/blockquote>\n<p><strong>\u4f7f\u7528\u8bf4\u660e<\/strong>\uff1a\u5141\u8bb8\u6240\u6709\u641c\u7d22\u5f15\u64ce\u6293\u53d6\uff0c\u9010\u4e00\u5217\u4e3e\u9700\u8981\u9650\u5236\u7684\u76ee\u5f55\uff0c\u9650\u5236\u6293\u53d6\u641c\u7d22\u7ed3\u679c\u3002<\/p>\n<p>\u5305\u542bsitemap.xml\u5730\u5740\uff08\u8fd9\u4e00\u9879<a href=\"http:\/\/en.wikipedia.org\/wiki\/Robots.txt\" target=\"_blank\">wiki<\/a>\u4e2d\u6709\u4e13\u95e8\u7684\u8bf4\u660e\uff0c\u4f46Google\u7ba1\u7406\u5458\u5de5\u5177\u4f1a\u63d0\u793a\u2018\u68c0\u6d4b\u5230\u65e0\u6548\u7684 Sitemap \u5f15\u7528\u2019\uff0c\u6709\u6548\u6027\u5c1a\u6709\u4e89\u8bae\uff09\u3002<\/p>\n<p><strong>robots.txt\u5176\u4ed6\u5199\u6cd5<\/strong>:\u4e3a\u907f\u514d\u5728\u641c\u7d22\u5f15\u64ce\u4e2d\u51fa\u73b0\u91cd\u590d\u9875\u9762\uff0cWordpress\u73a9\u5bb6\u81ea\u521b\u4e86\u5f88\u591arobots\u5199\u6cd5\uff0c\u5217\u4e3e\u4e00\u4e9b\u5e38\u7528\u7684\uff0c\u4f5c\u4e3a\u53c2\u8003\uff08\u9002\u7528\u4e8e\u4f2a\u9759\u6001\u65b9\u5f0f\u7684\u6c38\u4e45\u94fe\u63a5\uff09\uff1a<\/p>\n<blockquote><p>    * Disallow: \/page\/ #\u9650\u5236\u6293\u53d6Wordpress\u5206\u9875<br \/>\n    * Disallow: \/category\/*\/page\/* #\u9650\u5236\u6293\u53d6\u5206\u7c7b\u7684\u5206\u9875<br \/>\n    * Disallow: \/tag\/ #\u9650\u5236\u6293\u53d6\u6807\u7b7e\u9875\u9762<br \/>\n    * Disallow: *\/trackback\/ #\u9650\u5236\u6293\u53d6Trackback\u5185\u5bb9<br \/>\n    * Disallow: \/category\/* #\u9650\u5236\u6293\u53d6\u6240\u6709\u5206\u7c7b\u5217\u8868\n<\/p><\/blockquote>\n<p>\u6700\u540e\uff0c\u63a8\u8350\u4f7f\u7528 <a href=\"https:\/\/www.google.com\/webmasters\/tools\/\" target=\"_blank\">Google\u7ba1\u7406\u5458\u5de5\u5177<\/a>\uff0c\u767b\u5f55\u540e\u8bbf\u95ee\u201c\u5de5\u5177 -> \u5206\u6790 robots.txt\u201d\uff0c\u68c0\u67e5\u6587\u4ef6\u6709\u6548\u6027\u3002<\/p>\n","protected":false},"excerpt":{"rendered":"<p>WordPress \u81ea\u4ece2.1\u7248\u672c\u5f00\u59cb\uff0c\u5728 Privacy \u9009\u9879\u91cc\u9762\u5141\u8bb8\u7528\u6237\u8bbe\u7f6e\u662f\u5426\u88ab\u641c\u7d22\u5f15\u64ce\u7d22\u5f15\u3002\u4f46\u662f\u5b83\u53ea\u67092\u4e2a\u9009\u9879\uff0c\u4e00\u4e2a\u662f\u5141\u8bb8\u6240\u6709\u641c\u7d22\u5f15\u64ce\u7684\u673a\u5668\u4eba\uff08Spider\uff09\u7d22\u5f15\u6240\u6709\u5185\u5bb9\uff0c\u53e6\u5916\u4e00\u4e2a\u5c31\u662f\u4e0d\u5141\u8bb8\u3002\u5176\u5b9erobots.txt\u7684\u7528\u6cd5\u6709\u5f88\u591a\uff0c\u6211\u4eec\u53ef\u4ee5\u901a\u8fc7\u5b83\u6765\u544a\u8bc9\u641c\u7d22\u5f15\u64ce\u90a3\u4e9b\u76ee\u5f55\u53ef\u4ee5\u722c\uff0c\u54ea\u4e9b\u4e0d\u53ef\u4ee5\u722c\u3002 \u5728WordPress\u4e2d\u963b\u6b62Spider\u722c\u884c\u4e00\u4e9b\u76ee\u5f55\u548c\u6587\u4ef6\uff0c\u4e0d\u4f46\u53ef\u4ee5\u6709\u6548\u7684\u8282\u7701\u641c\u7d22\u5f15\u64ce\u5bf9\u670d\u52a1\u5668\u5e26\u5bbd\u7684\u5360\u7528\uff0c\u8fd8\u53ef\u4ee5\u63d0\u9ad8\u7f51\u7ad9\u5728\u641c\u7d22\u5f15\u64ce\u4e2d\u7684\u6392\u540d\u3002 \u4f7f\u7528WordPress\u642d\u5efa\u7684\u535a\u5ba2\uff0c\u5229\u7528robots.txt\u6587\u4ef6\u9650\u5236\u641c\u7d22\u5f15\u64ce\u6293\u53d6\u90e8\u5206\u76ee\u5f55\u53ca\u6587\u4ef6\uff0c\u5f52\u7eb3\u5927\u81f4\u6709\u4ee5\u4e0b\u51e0\u79cd\u65b9\u6cd5\u3002 \u6700\u7b80\u5355\u7684\u5f00\u653e\u5199\u6cd5\uff1a User-agent: * Disallow: \u4f7f\u7528\u8bf4\u660e\uff1a\u5141\u8bb8\u6240\u6709\u8718\u86db\u8bbf\u95ee\uff0c\u5141\u8bb8\u8bbf\u95ee\u6240\u6709\u5185\u5bb9\u3002Wordpress\u53ea\u8981\u6a21\u677f\u4e2d\u94fe\u63a5\u8bbe\u8ba1\u5408\u7406\uff0c\u6ca1\u6709\u9700\u8981\u9650\u5236\u7684\u7279\u6b8a\u5185\u5bb9\uff0c\u63a8\u8350\u4f7f\u7528\u8fd9\u79cd\u5199\u6cd5\u3002 \u6700\u7b80\u5355\u7684\u4e25\u683c\u5199\u6cd5\uff1a User-agent: * Disallow: \/wp-* #Allow: \/wp-content\/uploads\/ Disallow: \/*.php$ Disallow: \/*.inc$ Disallow: \/*.js$ Disallow: \/*.css$ Disallow: \/?s= \u4f7f\u7528\u8bf4\u660e\uff1a\u5141\u8bb8\u6240\u6709\u8718\u86db\u8bbf\u95ee\uff0c\u9650\u5236\u4ee5\u201cwp-\u201d\u5f00\u5934\u7684\u76ee\u5f55\u53ca\u6587\u4ef6\uff0c\u9650\u5236\u6293\u53d6.php\u6587\u4ef6\u3001.inc\u6587\u4ef6\u3001.js\u6587\u4ef6\u3001.css\u6587\u4ef6\uff0c\u9650\u5236\u6293\u53d6\u641c\u7d22\u7ed3\u679c\u3002 Disallow: \/wp-* \u4f1a\u8fde\u540c\u9644\u4ef6\u76ee\u5f55\u4e00\u8d77\u9650\u5236\u6293\u53d6\uff0c\u5982\u679c\u60f3\u8ba9\u641c\u7d22\u5f15\u64ce\u6293\u53d6\u9644\u4ef6\u4e2d\u7684\u5185\u5bb9\uff0c\u5c06\u7b2c\u4e09\u884c\u7684 # \u53f7\u6ce8\u91ca\u53bb\u6389\u3002Allow \u4e0d\u662f\u6240\u6709\u641c\u7d22\u5f15\u64ce\u90fd\u652f\u6301\u3002 \u6700\u5408\u7406\u7684\u5199\u6cd5\uff1a User-agent: * Disallow: \/wp-admin Disallow: \/wp-content\/plugins Disallow: \/wp-content\/themes Disallow: \/wp-includes Disallow: \/?s= Sitemap: http:\/\/domain\/sitemap.xml \u4f7f\u7528\u8bf4\u660e\uff1a\u5141\u8bb8\u6240\u6709\u641c\u7d22\u5f15\u64ce\u6293\u53d6\uff0c\u9010\u4e00\u5217\u4e3e\u9700\u8981\u9650\u5236\u7684\u76ee\u5f55\uff0c\u9650\u5236\u6293\u53d6\u641c\u7d22\u7ed3\u679c\u3002 \u5305\u542bsitemap.xml\u5730\u5740\uff08\u8fd9\u4e00\u9879wiki\u4e2d\u6709\u4e13\u95e8\u7684\u8bf4\u660e\uff0c\u4f46Google\u7ba1\u7406\u5458\u5de5\u5177\u4f1a\u63d0\u793a\u2018\u68c0\u6d4b\u5230\u65e0\u6548\u7684 Sitemap \u5f15\u7528\u2019\uff0c\u6709\u6548\u6027\u5c1a\u6709\u4e89\u8bae\uff09\u3002 robots.txt\u5176\u4ed6\u5199\u6cd5:\u4e3a\u907f\u514d\u5728\u641c\u7d22\u5f15\u64ce\u4e2d\u51fa\u73b0\u91cd\u590d\u9875\u9762\uff0cWordpress\u73a9\u5bb6\u81ea\u521b\u4e86\u5f88\u591arobots\u5199\u6cd5\uff0c\u5217\u4e3e\u4e00\u4e9b\u5e38\u7528\u7684\uff0c\u4f5c\u4e3a\u53c2\u8003\uff08\u9002\u7528\u4e8e\u4f2a\u9759\u6001\u65b9\u5f0f\u7684\u6c38\u4e45\u94fe\u63a5\uff09\uff1a [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[44],"tags":[240,313,493,614],"class_list":["post-998","post","type-post","status-publish","format-standard","hentry","category-seo-blog-article","tag-robotstxt","tag-wordpress","tag-wordpress-seo"],"_links":{"self":[{"href":"https:\/\/wopus.org\/index.php?rest_route=\/wp\/v2\/posts\/998","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/wopus.org\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/wopus.org\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/wopus.org\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/wopus.org\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=998"}],"version-history":[{"count":0,"href":"https:\/\/wopus.org\/index.php?rest_route=\/wp\/v2\/posts\/998\/revisions"}],"wp:attachment":[{"href":"https:\/\/wopus.org\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=998"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/wopus.org\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=998"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/wopus.org\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=998"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}