{"id":226,"date":"2013-07-17T07:46:00","date_gmt":"2013-07-17T07:46:00","guid":{"rendered":"https:\/\/kiencang.net\/2013\/07\/17\/cung-tim-hieu-file-robots-txt-ke-dan-duong-chi-loi-cho-bo-tim-kiem\/"},"modified":"2021-10-17T05:34:08","modified_gmt":"2021-10-16T22:34:08","slug":"cung-tim-hieu-file-robots-txt-ke-dan-duong-chi-loi-cho-bo-tim-kiem","status":"publish","type":"post","link":"https:\/\/kiencang.net\/cung-tim-hieu-file-robots-txt-ke-dan-duong-chi-loi-cho-bo-tim-kiem\/","title":{"rendered":"C\u00f9ng t\u00ecm hi\u1ec3u file robots.txt &#8211; k\u1ebb d\u1eabn \u0111\u01b0\u1eddng ch\u1ec9 l\u1ed1i cho b\u1ecd t\u00ecm ki\u1ebfm"},"content":{"rendered":"\n<p>Robots.txt kh\u00f4ng ph\u1ea3i l\u00e0 m\u1ed9t file HTML, ch\u1eb3ng c\u00f3 t\u00ed code HTML n\u00e0o c\u1ea3, th\u1ef1c ra nh\u00ecn v\u00e0o \u0111u\u00f4i .txt th\u00ec b\u1ea1n \u0111\u00e3 \u0111\u1ee7 r\u00f5, n\u00f3 ch\u1ec9 l\u00e0 file text r\u1ea5t \u0111\u01a1n gi\u1ea3n nh\u01b0ng l\u1ea1i v\u00f4 c\u00f9ng quan tr\u1ecdng v\u1edbi m\u1ed9t trang web.<\/p>\n\n\n\n<!--more-->\n\n\n\n<p>Robots.txt l\u00e0 file m\u00e0 b\u1ea5t k\u1ef3 b\u1ecd t\u00ecm ki\u1ebfm n\u00e0o nh\u01b0 Google, Bing, Yahoo&#8230; ph\u1ea3i \u0111\u1ecdc tr\u01b0\u1edbc khi l\u1ee5c l\u1ecdi \u0111\u1ec3 l\u1eadp ch\u1ec9 m\u1ee5c trang web. N\u00f3 gi\u1ed1ng ki\u1ec3u b\u1ea3ng n\u1ed9i quy v\u00e0 h\u01b0\u1edbng d\u1eabn trong \u0111\u00f3 ghi: n\u00e0y m\u1ea5y b\u1ecd t\u00ecm ki\u1ebfm, c\u00e1c ch\u00fa ch\u1ec9 \u0111\u01b0\u1ee3c v\u00e0o nh\u1eefng khu v\u1ef1c n\u00e0y c\u1ee7a anh, nh\u1eefng khu v\u1ef1c kia th\u00ec kh\u00f4ng \u0111\u01b0\u1ee3c v\u00e0o nh\u00f2m ng\u00f3. Robots.txt c\u0169ng cho ph\u00e9p b\u1ea1n ch\u1eb7n h\u1eb3n m\u1ed9t s\u1ed1 b\u1ecd t\u00ecm ki\u1ebfm m\u00e0 b\u1ea1n kh\u00f4ng th\u00edch ho\u1eb7c th\u1ea5y kh\u00f4ng c\u1ea7n thi\u1ebft.<\/p>\n\n\n\n<p>\u0110\u1ebfn \u0111\u00e2y b\u1ea1n t\u1ef1 h\u1ecfi, th\u1ebf l\u1ee3i \u00edch c\u1ee7a&nbsp;Robots.txt&nbsp;l\u00e0 g\u00ec v\u1eady? V\u00e0 d\u01b0\u1edbi \u0111\u00e2y l\u00e0 c\u00e2u tr\u1ea3 l\u1eddi:<\/p>\n\n\n\n<ul><li>C\u00f3 nh\u1eefng th\u01b0 m\u1ee5c, t\u1ec7p tin b\u1ea1n kh\u00f4ng mu\u1ed1n b\u1ecd t\u00ecm ki\u1ebfm l\u1eadp ch\u1ec9 m\u1ee5c, c\u00f3 th\u1ec3 v\u00ec n\u00f3 l\u00e0 n\u1ed9i dung ri\u00eang t\u01b0 ho\u1eb7c n\u1ed9i dung \u0111\u00e3 c\u0169 ho\u1eb7c tr\u00f9ng l\u1eb7p&#8230;<\/li><li>Vi\u1ec7c lo\u1ea1i b\u1ecf c\u00e1c khu v\u1ef1c kh\u00f4ng c\u1ea7n l\u1eadp ch\u1ec9 m\u1ee5c gi\u00fap cho b\u1ecd c\u00f3 nhi\u1ec1u s\u1ee9c l\u1ef1c h\u01a1n \u0111\u1ec3 l\u1eadp ch\u1ec9 m\u1ee5c c\u00e1c khu v\u1ef1c quan tr\u1ecdng kh\u00e1c trong trang web.<\/li><li>Robots.txt ch\u1ee9a c\u1ea3 sitemap &#8211; t\u1ee9c l\u00e0 b\u1ea3n \u0111\u1ed3 \u0111\u01b0\u1eddng d\u1eabn c\u1ee7a trang web, gi\u00fap b\u1ecd bi\u1ebft \u0111\u01b0\u1eddng \u0111i l\u1ed1i l\u1ea1i r\u00f5 r\u00e0ng h\u01a1n, \u0111i\u1ec1u n\u00e0y c\u0169ng gi\u00fap l\u1eadp ch\u1ec9 m\u1ee5c nhanh v\u00e0 \u0111\u1ea7y \u0111\u1ee7 h\u01a1n.<\/li><\/ul>\n\n\n\n<p>Robots.txt c\u1ea7n \u0111\u01b0a l\u00ean th\u01b0 m\u1ee5c g\u1ed1c c\u1ee7a trang web, do v\u1eady \u0111\u1ecba ch\u1ec9 c\u1ee7a n\u00f3 th\u01b0\u1eddng l\u00e0 th\u1ebf n\u00e0y: ten-mien-cua-ban.com\/robots.txt. Th\u00ed d\u1ee5 nh\u00e9, \u0111\u00e2y l\u00e0 file robots.txt c\u1ee7a trang b\u1ea1n \u0111ang \u0111\u1ecdc:\u00a0<a href=\"https:\/\/kiencang.net\/robots.txt\" target=\"_blank\" rel=\"noopener\">https:\/\/kiencang.net\/robots.txt<\/a><\/p>\n\n\n\n<pre class=\"wp-block-preformatted\">User-agent: Mediapartners-Google\nDisallow: \n\nUser-agent: *\nDisallow: \/search\nAllow: \/\n\nSitemap: https:\/\/kiencang.net\/feeds\/posts\/default?orderby=UPDATED<\/pre>\n\n\n\n<p>D\u01b0\u1edbi \u0111\u00e2y l\u00e0 gi\u1ea3i th\u00edch:<\/p>\n\n\n\n<ul><li><span style=\"font-family: Courier New, Courier, monospace;\">User-agent: Mediapartners-Google<\/span> l\u00e0 ch\u1ec9 \u0111\u00edch danh b\u1ecd t\u00ecm ki\u1ebfm Google.<\/li><li><span style=\"font-family: Courier New, Courier, monospace;\">User-agent: *<\/span> l\u00e0 ch\u1ec9 \u0111\u1ebfn t\u1ea5t c\u1ea3 c\u00e1c b\u1ecd t\u00ecm ki\u1ebfm.<\/li><li><span style=\"font-family: Courier New, Courier, monospace;\">Disallow<\/span> ngh\u0129a l\u00e0 kh\u00f4ng cho ph\u00e9p l\u1ee5c l\u1ecdi \u1edf \u0111\u00e2y,&nbsp;<span style=\"font-family: Courier New, Courier, monospace;\">Allow: \/<\/span> l\u00e0 cho ph\u00e9p.<\/li><li><span style=\"font-family: Courier New, Courier, monospace;\">Disallow: \/search<\/span> ngh\u0129a l\u00e0 kh\u00f4ng \u0111\u01b0\u1ee3c v\u00e0o khu v\u1ef1c c\u00f3 d\u1ea1ng ten-mien-cau-ban.com\/search\/<\/li><li><span style=\"font-family: Courier New, Courier, monospace;\">Sitemap:<\/span> ch\u00ednh l\u00e0 b\u1ea3n \u0111\u1ed3 trang web.<\/li><\/ul>\n\n\n\n<p>N\u1ebfu b\u1ea1n d\u00f9ng c\u00e1c h\u1ec7 qu\u1ea3n tr\u1ecb n\u1ed9i dung nh\u01b0 WordPress, Joomla, Drupal th\u00ec n\u00ean t\u00ecm ki\u1ebfm tr\u00ean m\u1ea1ng m\u1ed9t s\u1ed1 th\u00f4ng tin v\u1ec1 c\u1ea5u h\u00ecnh robots.txt sao cho t\u1ed1i \u01b0u nh\u1ea5t v\u1edbi trang c\u1ee7a b\u1ea1n. Tuy nhi\u00ean c\u0169ng h\u1ebft s\u1ee9c th\u1eadn tr\u1ecdng khi can thi\u1ec7p v\u00e0o robots.txt b\u1edfi n\u1ebfu kh\u00f4ng c\u1ea9n th\u1eadn c\u00f3 th\u1ec3 b\u1ea1n s\u1ebd v\u00f4 t\u00ecnh ch\u1eb7n bot l\u1eadp ch\u1ec9 m\u1ee5c c\u00e1c n\u1ed9i dung trang web \u1edf nh\u1eefng ph\u1ea7n m\u00e0 b\u1ea1n kh\u00f4ng h\u1ec1 mu\u1ed1n ch\u1eb7n.<\/p>\n\n\n\n<p>\u0110\u1ec3 ch\u1ec9nh s\u1eeda robots.txt theo c\u00e1ch th\u1ee7 c\u00f4ng th\u00ec \u0111\u01a1n gi\u1ea3n nh\u1ea5t l\u00e0 d\u00f9ng Notepad. Ngo\u00e0i ra tr\u00ean m\u1ea1ng c\u0169ng c\u00f3 nhi\u1ec1u trang t\u1ea1o t\u1ef1 \u0111\u1ed9ng n\u1ed9i dung robots.txt, b\u1ea1n ch\u1ec9 vi\u1ec7c \u0111i\u1ec1n th\u00f4ng tin v\u00e0o r\u1ed3i nh\u1ea5n n\u00fat t\u1ea1o l\u00e0 xong. V\u00ed d\u1ee5 m\u1ed9t trang nh\u01b0 th\u1ebf:\u00a0<a href=\"http:\/\/www.mcanerin.com\/EN\/search-engine\/robots-txt.asp\" target=\"_blank\" rel=\"noreferrer noopener\">http:\/\/www.mcanerin.com\/EN\/search-engine\/robots-txt.asp<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Robots.txt kh\u00f4ng ph\u1ea3i l\u00e0 m\u1ed9t file HTML, ch\u1eb3ng c\u00f3 t\u00ed code HTML n\u00e0o c\u1ea3, th\u1ef1c ra nh\u00ecn v\u00e0o \u0111u\u00f4i .txt th\u00ec b\u1ea1n \u0111\u00e3 \u0111\u1ee7 r\u00f5, n\u00f3 ch\u1ec9 l\u00e0 file text r\u1ea5t \u0111\u01a1n gi\u1ea3n nh\u01b0ng l\u1ea1i v\u00f4 c\u00f9ng quan tr\u1ecdng v\u1edbi m\u1ed9t trang web.<\/p>\n","protected":false},"author":1,"featured_media":1120,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[39],"tags":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v21.6 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>C\u00f9ng t\u00ecm hi\u1ec3u file robots.txt - k\u1ebb d\u1eabn \u0111\u01b0\u1eddng ch\u1ec9 l\u1ed1i cho b\u1ecd t\u00ecm ki\u1ebfm &#8226; Ki\u1ebfn c\u00e0ng<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/kiencang.net\/cung-tim-hieu-file-robots-txt-ke-dan-duong-chi-loi-cho-bo-tim-kiem\/\" \/>\n<meta property=\"og:locale\" content=\"vi_VN\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"C\u00f9ng t\u00ecm hi\u1ec3u file robots.txt - k\u1ebb d\u1eabn \u0111\u01b0\u1eddng ch\u1ec9 l\u1ed1i cho b\u1ecd t\u00ecm ki\u1ebfm &#8226; Ki\u1ebfn c\u00e0ng\" \/>\n<meta property=\"og:description\" content=\"Robots.txt kh\u00f4ng ph\u1ea3i l\u00e0 m\u1ed9t file HTML, ch\u1eb3ng c\u00f3 t\u00ed code HTML n\u00e0o c\u1ea3, th\u1ef1c ra nh\u00ecn v\u00e0o \u0111u\u00f4i .txt th\u00ec b\u1ea1n \u0111\u00e3 \u0111\u1ee7 r\u00f5, n\u00f3 ch\u1ec9 l\u00e0 file text r\u1ea5t \u0111\u01a1n gi\u1ea3n nh\u01b0ng l\u1ea1i v\u00f4 c\u00f9ng quan tr\u1ecdng v\u1edbi m\u1ed9t trang web.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/kiencang.net\/cung-tim-hieu-file-robots-txt-ke-dan-duong-chi-loi-cho-bo-tim-kiem\/\" \/>\n<meta property=\"og:site_name\" content=\"Ki\u1ebfn c\u00e0ng\" \/>\n<meta property=\"article:author\" content=\"https:\/\/www.facebook.com\/anhducnguyen87\/\" \/>\n<meta property=\"article:published_time\" content=\"2013-07-17T07:46:00+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2021-10-16T22:34:08+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/kiencang.net\/wp-content\/uploads\/2013\/07\/bo-tim-kiem.png\" \/>\n\t<meta property=\"og:image:width\" content=\"350\" \/>\n\t<meta property=\"og:image:height\" content=\"236\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"author\" content=\"Nguy\u1ec5n \u0110\u1ee9c Anh\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"\u0110\u01b0\u1ee3c vi\u1ebft b\u1edfi\" \/>\n\t<meta name=\"twitter:data1\" content=\"Nguy\u1ec5n \u0110\u1ee9c Anh\" \/>\n\t<meta name=\"twitter:label2\" content=\"\u01af\u1edbc t\u00ednh th\u1eddi gian \u0111\u1ecdc\" \/>\n\t<meta name=\"twitter:data2\" content=\"3 ph\u00fat\" \/>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"C\u00f9ng t\u00ecm hi\u1ec3u file robots.txt - k\u1ebb d\u1eabn \u0111\u01b0\u1eddng ch\u1ec9 l\u1ed1i cho b\u1ecd t\u00ecm ki\u1ebfm &#8226; Ki\u1ebfn c\u00e0ng","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/kiencang.net\/cung-tim-hieu-file-robots-txt-ke-dan-duong-chi-loi-cho-bo-tim-kiem\/","og_locale":"vi_VN","og_type":"article","og_title":"C\u00f9ng t\u00ecm hi\u1ec3u file robots.txt - k\u1ebb d\u1eabn \u0111\u01b0\u1eddng ch\u1ec9 l\u1ed1i cho b\u1ecd t\u00ecm ki\u1ebfm &#8226; Ki\u1ebfn c\u00e0ng","og_description":"Robots.txt kh\u00f4ng ph\u1ea3i l\u00e0 m\u1ed9t file HTML, ch\u1eb3ng c\u00f3 t\u00ed code HTML n\u00e0o c\u1ea3, th\u1ef1c ra nh\u00ecn v\u00e0o \u0111u\u00f4i .txt th\u00ec b\u1ea1n \u0111\u00e3 \u0111\u1ee7 r\u00f5, n\u00f3 ch\u1ec9 l\u00e0 file text r\u1ea5t \u0111\u01a1n gi\u1ea3n nh\u01b0ng l\u1ea1i v\u00f4 c\u00f9ng quan tr\u1ecdng v\u1edbi m\u1ed9t trang web.","og_url":"https:\/\/kiencang.net\/cung-tim-hieu-file-robots-txt-ke-dan-duong-chi-loi-cho-bo-tim-kiem\/","og_site_name":"Ki\u1ebfn c\u00e0ng","article_author":"https:\/\/www.facebook.com\/anhducnguyen87\/","article_published_time":"2013-07-17T07:46:00+00:00","article_modified_time":"2021-10-16T22:34:08+00:00","og_image":[{"width":350,"height":236,"url":"https:\/\/kiencang.net\/wp-content\/uploads\/2013\/07\/bo-tim-kiem.png","type":"image\/png"}],"author":"Nguy\u1ec5n \u0110\u1ee9c Anh","twitter_card":"summary_large_image","twitter_misc":{"\u0110\u01b0\u1ee3c vi\u1ebft b\u1edfi":"Nguy\u1ec5n \u0110\u1ee9c Anh","\u01af\u1edbc t\u00ednh th\u1eddi gian \u0111\u1ecdc":"3 ph\u00fat"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/kiencang.net\/cung-tim-hieu-file-robots-txt-ke-dan-duong-chi-loi-cho-bo-tim-kiem\/","url":"https:\/\/kiencang.net\/cung-tim-hieu-file-robots-txt-ke-dan-duong-chi-loi-cho-bo-tim-kiem\/","name":"C\u00f9ng t\u00ecm hi\u1ec3u file robots.txt - k\u1ebb d\u1eabn \u0111\u01b0\u1eddng ch\u1ec9 l\u1ed1i cho b\u1ecd t\u00ecm ki\u1ebfm &#8226; Ki\u1ebfn c\u00e0ng","isPartOf":{"@id":"https:\/\/kiencang.net\/#website"},"datePublished":"2013-07-17T07:46:00+00:00","dateModified":"2021-10-16T22:34:08+00:00","author":{"@id":"https:\/\/kiencang.net\/#\/schema\/person\/5e7e1a04d8d1218ad8c421ba43d25c16"},"breadcrumb":{"@id":"https:\/\/kiencang.net\/cung-tim-hieu-file-robots-txt-ke-dan-duong-chi-loi-cho-bo-tim-kiem\/#breadcrumb"},"inLanguage":"vi","potentialAction":[{"@type":"ReadAction","target":["https:\/\/kiencang.net\/cung-tim-hieu-file-robots-txt-ke-dan-duong-chi-loi-cho-bo-tim-kiem\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/kiencang.net\/cung-tim-hieu-file-robots-txt-ke-dan-duong-chi-loi-cho-bo-tim-kiem\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/kiencang.net\/"},{"@type":"ListItem","position":2,"name":"C\u00f9ng t\u00ecm hi\u1ec3u file robots.txt &#8211; k\u1ebb d\u1eabn \u0111\u01b0\u1eddng ch\u1ec9 l\u1ed1i cho b\u1ecd t\u00ecm ki\u1ebfm"}]},{"@type":"WebSite","@id":"https:\/\/kiencang.net\/#website","url":"https:\/\/kiencang.net\/","name":"Ki\u1ebfn c\u00e0ng","description":"\u00d4m l\u00fd thuy\u1ebft, h\u00f4n th\u1ef1c h\u00e0nh","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/kiencang.net\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"vi"},{"@type":"Person","@id":"https:\/\/kiencang.net\/#\/schema\/person\/5e7e1a04d8d1218ad8c421ba43d25c16","name":"Nguy\u1ec5n \u0110\u1ee9c Anh","image":{"@type":"ImageObject","inLanguage":"vi","@id":"https:\/\/kiencang.net\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/6d71f9b89393952a8382e30dad26c1ec?s=96&d=monsterid&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/6d71f9b89393952a8382e30dad26c1ec?s=96&d=monsterid&r=g","caption":"Nguy\u1ec5n \u0110\u1ee9c Anh"},"description":"Sinh n\u0103m 1987, t\u1ed1t nghi\u1ec7p Cao \u0111\u1eb3ng th\u1ef1c h\u00e0nh FPT qu\u00e3ng 2014, chuy\u00ean ng\u00e0nh Thi\u1ebft k\u1ebf website. T\u00f4i th\u00edch Content, SEO, Ads, T\u0103ng t\u1ed1c website v\u00e0 Th\u01b0\u01a1ng m\u1ea1i \u0111i\u1ec7n t\u1eed. B\u00ean c\u1ea1nh b\u00e0i t\u1ef1 vi\u1ebft, t\u00f4i c\u0169ng d\u1ecbch nhi\u1ec1u n\u1ed9i dung th\u00fa v\u1ecb c\u1ee7a c\u00e1c t\u00e1c gi\u1ea3 kh\u00e1c nhau. FB c\u00e1 nh\u00e2n: facebook.com\/anhducnguyen87. Email li\u00ean h\u1ec7: guiemailchotoi@gmail.com","sameAs":["https:\/\/www.facebook.com\/anhducnguyen87\/"],"url":"https:\/\/kiencang.net\/author\/admin\/"}]}},"_links":{"self":[{"href":"https:\/\/kiencang.net\/wp-json\/wp\/v2\/posts\/226"}],"collection":[{"href":"https:\/\/kiencang.net\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/kiencang.net\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/kiencang.net\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/kiencang.net\/wp-json\/wp\/v2\/comments?post=226"}],"version-history":[{"count":0,"href":"https:\/\/kiencang.net\/wp-json\/wp\/v2\/posts\/226\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/kiencang.net\/wp-json\/wp\/v2\/media\/1120"}],"wp:attachment":[{"href":"https:\/\/kiencang.net\/wp-json\/wp\/v2\/media?parent=226"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/kiencang.net\/wp-json\/wp\/v2\/categories?post=226"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/kiencang.net\/wp-json\/wp\/v2\/tags?post=226"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}