{"id":31157,"date":"2023-06-12T12:01:52","date_gmt":"2023-06-12T12:01:52","guid":{"rendered":"https:\/\/seo.london\/?p=31157"},"modified":"2023-06-29T16:47:23","modified_gmt":"2023-06-29T16:47:23","slug":"jak-blokovat-roboty-pomoci-robots-txt","status":"publish","type":"post","link":"https:\/\/seo.london\/cs\/jak-blokovat-roboty-pomoci-robots-txt\/","title":{"rendered":"Jak blokovat roboty pomoc\u00ed souboru Robots.txt?"},"content":{"rendered":"<p class=\"wp-block-paragraph\">Neinformovan\u00e9mu pozorovateli m\u016f\u017ee robot, kter\u00fd se potuluje po va\u0161ich webov\u00fdch str\u00e1nk\u00e1ch, p\u0159ipadat jako z n\u011bjak\u00e9ho sci-fi filmu. V\u011b\u0159te tomu nebo ne, ale k fikci to m\u00e1 daleko a je to bl\u00ed\u017e realit\u011b, ne\u017e si mysl\u00edte! Pro ka\u017ed\u00e9ho, kdo se pohybuje v ter\u00e9nu vlastnictv\u00ed a \u00fadr\u017eby webov\u00fdch str\u00e1nek, je z\u00e1sadn\u00ed pochopit, jak roboti interaguj\u00ed s na\u0161\u00edm online prostorem. Stejn\u011b z\u00e1sadn\u00ed je m\u00edt schopnost tuto interakci regulovat. Tato pot\u0159eba n\u00e1s seznamuje s u\u017eite\u010dn\u00fdm n\u00e1strojem: <a href=\"https:\/\/seo.london\/cs\/jak-pouzivat-soubor-robots-txt-v-seo\/\">roboti<\/a>.txt. V tomto komplexn\u00edm <a href=\"https:\/\/seo.london\/cs\/naucte-se-seo\/\">pr\u016fvodce<\/a>, budeme dek\u00f3dovat <a href=\"https:\/\/seo.london\/cs\/budovani-odkazu-jak-co-delat-donts\/\">co<\/a> \"jak blokovat roboty txt\" a pro\u010d je to v dne\u0161n\u00ed digit\u00e1ln\u00ed dob\u011b d\u016fle\u017eit\u00e9.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"h-what-is-a-robots-txt-file\"><span class=\"ez-toc-section\" id=\"what-is-a-robotstxt-file\"><\/span>Co je soubor Robots.txt?<span class=\"ez-toc-section-end\"><\/span><\/h2><div id=\"ez-toc-container\" class=\"ez-toc-v2_0_69_1 counter-hierarchy ez-toc-counter ez-toc-grey ez-toc-container-direction\">\n<div class=\"ez-toc-title-container\">\n<p class=\"ez-toc-title\" style=\"cursor:inherit\">Obsah<\/p>\n<span class=\"ez-toc-title-toggle\"><a href=\"#\" class=\"ez-toc-pull-right ez-toc-btn ez-toc-btn-xs ez-toc-btn-default ez-toc-toggle\" aria-label=\"P\u0159epnut\u00ed tabulky obsahu\"><span class=\"ez-toc-js-icon-con\"><span class=\"\"><span class=\"eztoc-hide\" style=\"display:none;\">P\u0159ep\u00edna\u010d<\/span><span class=\"ez-toc-icon-toggle-span\"><svg style=\"fill: #000000;color:#000000\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" class=\"list-377408\" width=\"20px\" height=\"20px\" viewbox=\"0 0 24 24\" fill=\"none\"><path d=\"M6 6H4v2h2V6zm14 0H8v2h12V6zM4 11h2v2H4v-2zm16 0H8v2h12v-2zM4 16h2v2H4v-2zm16 0H8v2h12v-2z\" fill=\"currentColor\"><\/path><\/svg><svg style=\"fill: #000000;color:#000000\" class=\"arrow-unsorted-368013\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"10px\" height=\"10px\" viewbox=\"0 0 24 24\" version=\"1.2\" baseprofile=\"tiny\"><path d=\"M18.2 9.3l-6.2-6.3-6.2 6.3c-.2.2-.3.4-.3.7s.1.5.3.7c.2.2.4.3.7.3h11c.3 0 .5-.1.7-.3.2-.2.3-.5.3-.7s-.1-.5-.3-.7zM5.8 14.7l6.2 6.3 6.2-6.3c.2-.2.3-.5.3-.7s-.1-.5-.3-.7c-.2-.2-.4-.3-.7-.3h-11c-.3 0-.5.1-.7.3-.2.2-.3.5-.3.7s.1.5.3.7z\"\/><\/svg><\/span><\/span><\/span><\/a><\/span><\/div>\n<nav><ul class='ez-toc-list ez-toc-list-level-1 eztoc-toggle-hide-by-default' ><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-1\" href=\"https:\/\/seo.london\/cs\/jak-blokovat-roboty-pomoci-robots-txt\/#what-is-a-robotstxt-file\" title=\"Co je soubor Robots.txt?\">Co je soubor Robots.txt?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-2\" href=\"https:\/\/seo.london\/cs\/jak-blokovat-roboty-pomoci-robots-txt\/#technical-robotstxt-syntax\" title=\"Technick\u00e1 syntaxe souboru Robots.txt\">Technick\u00e1 syntaxe souboru Robots.txt<\/a><ul class='ez-toc-list-level-3' ><li class='ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-3\" href=\"https:\/\/seo.london\/cs\/jak-blokovat-roboty-pomoci-robots-txt\/#pattern-matching\" title=\"Pattern-Matching\">Pattern-Matching<\/a><\/li><\/ul><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-4\" href=\"https:\/\/seo.london\/cs\/jak-blokovat-roboty-pomoci-robots-txt\/#checking-if-you-have-a-robotstxt-file\" title=\"Kontrola, zda m\u00e1te soubor robots.txt\">Kontrola, zda m\u00e1te soubor robots.txt<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-5\" href=\"https:\/\/seo.london\/cs\/jak-blokovat-roboty-pomoci-robots-txt\/#how-to-create-a-robotstxt-file\" title=\"Jak vytvo\u0159it soubor Robots.txt\">Jak vytvo\u0159it soubor Robots.txt<\/a><ul class='ez-toc-list-level-3' ><li class='ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-6\" href=\"https:\/\/seo.london\/cs\/jak-blokovat-roboty-pomoci-robots-txt\/#understanding-the-components-of-robotstxt\" title=\"Porozum\u011bn\u00ed sou\u010d\u00e1stem souboru Robots.txt\">Porozum\u011bn\u00ed sou\u010d\u00e1stem souboru Robots.txt<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-7\" href=\"https:\/\/seo.london\/cs\/jak-blokovat-roboty-pomoci-robots-txt\/#fresh-file-generation\" title=\"Generov\u00e1n\u00ed \u010derstv\u00fdch soubor\u016f\">Generov\u00e1n\u00ed \u010derstv\u00fdch soubor\u016f<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-8\" href=\"https:\/\/seo.london\/cs\/jak-blokovat-roboty-pomoci-robots-txt\/#uploading-your-file\" title=\"Nahr\u00e1v\u00e1n\u00ed soubor\u016f\">Nahr\u00e1v\u00e1n\u00ed soubor\u016f<\/a><\/li><\/ul><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-9\" href=\"https:\/\/seo.london\/cs\/jak-blokovat-roboty-pomoci-robots-txt\/#blocking-specific-bots-and-filesfolders\" title=\"Blokov\u00e1n\u00ed konkr\u00e9tn\u00edch bot\u016f a soubor\u016f\/slo\u017eek\">Blokov\u00e1n\u00ed konkr\u00e9tn\u00edch bot\u016f a soubor\u016f\/slo\u017eek<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-10\" href=\"https:\/\/seo.london\/cs\/jak-blokovat-roboty-pomoci-robots-txt\/#robotstxt-vs-meta-robots-vs-x-robots\" title=\"Robots.txt vs Meta Robots vs X-Robots\">Robots.txt vs Meta Robots vs X-Robots<\/a><ul class='ez-toc-list-level-3' ><li class='ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-11\" href=\"https:\/\/seo.london\/cs\/jak-blokovat-roboty-pomoci-robots-txt\/#the-robotstxt-file\" title=\"Soubor Robots.txt\">Soubor Robots.txt<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-12\" href=\"https:\/\/seo.london\/cs\/jak-blokovat-roboty-pomoci-robots-txt\/#what-are-meta-robots-tags\" title=\"Co jsou meta zna\u010dky robot\u016f?\">Co jsou meta zna\u010dky robot\u016f?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-13\" href=\"https:\/\/seo.london\/cs\/jak-blokovat-roboty-pomoci-robots-txt\/#how-do-x-robots-tags-work\" title=\"Jak funguj\u00ed \u0161t\u00edtky X-Robots?\">Jak funguj\u00ed \u0161t\u00edtky X-Robots?<\/a><\/li><\/ul><\/li><\/ul><\/nav><\/div>\n\n\n\n\n<p class=\"wp-block-paragraph\">Soubor robots.txt je v podstat\u011b str\u00e1\u017ecem va\u0161ich webov\u00fdch str\u00e1nek. Umo\u017e\u0148uje v\u00e1m kontrolovat <a href=\"https:\/\/seo.london\/cs\/eskortni-seo-sluzby\/\">kter\u00fd<\/a> \u010d\u00e1sti va\u0161eho webu jsou k dispozici pro pr\u016fzkum botem - podobn\u011b jako u Google <a href=\"https:\/\/seo.london\/cs\/jak-provadet-pokrocile-vyhledavani-v-googlu\/\">vyhled\u00e1v\u00e1n\u00ed<\/a> a kter\u00e9 by m\u011bly b\u00fdt zak\u00e1z\u00e1ny. Funguje jako sou\u010d\u00e1st standardu pro vylou\u010den\u00ed robot\u016f (neofici\u00e1ln\u00ed standard pou\u017e\u00edvan\u00fd weby) a instruuje webov\u00e9 roboty o jejich povolen\u00fdch akc\u00edch p\u0159i n\u00e1v\u0161t\u011bv\u011b va\u0161ich webov\u00fdch str\u00e1nek.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Tento skromn\u00fd textov\u00fd soubor vypov\u00edd\u00e1 o va\u0161ich preferenc\u00edch p\u0159\u00edstupnosti str\u00e1nek. M\u00e1te konkr\u00e9tn\u00ed adres\u00e1\u0159e nebo str\u00e1nky, kter\u00e9 chcete uchr\u00e1nit p\u0159ed zv\u011bdav\u00fdma o\u010dima robot\u016f? Soubor robots.txt se o v\u00e1s postar\u00e1! Jeho obsah jednodu\u0161e stanovuje sm\u011brnice - konkr\u00e9tn\u00ed pokyny pro webov\u00e9 prohl\u00ed\u017ee\u010de - kter\u00e9 jsou vhodn\u00e9 pro efektivn\u011bj\u0161\u00ed spr\u00e1vu p\u0159\u00edstupu k webu. Tato vynal\u00e9zavost umo\u017e\u0148uje zajistit spr\u00e1vnou prezentaci <a href=\"https:\/\/seo.london\/cs\/obsah-marketing-seo-sluzby\/\">obsah<\/a> p\u0159i vyhled\u00e1v\u00e1n\u00ed a z\u00e1rove\u0148 chr\u00e1n\u00ed citliv\u00e9 oblasti p\u0159ed n\u00e1hodn\u00fdm odhalen\u00edm.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Nakonec se nau\u010d\u00edme, jak odd\u011blit \u010d\u00e1sti na\u0161\u00ed kybernetick\u00e9 <a href=\"https:\/\/seo.london\/cs\/jak-ziskat-vice-odkazujicich-domen\/\">dom\u00e9ny<\/a> p\u0159esn\u011b n\u00e1m jako webmaster\u016fm umo\u017e\u0148uje l\u00e9pe se orientovat v p\u0159\u00edtomnosti bot\u016f a jejich vlivu ve vz\u00e1cn\u00fdch sf\u00e9r\u00e1ch na\u0161ich platforem - proto se na n\u011b dnes zam\u011b\u0159\u00edme.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"h-technical-robots-txt-syntax\"><span class=\"ez-toc-section\" id=\"technical-robotstxt-syntax\"><\/span>Technick\u00e1 syntaxe souboru Robots.txt<span class=\"ez-toc-section-end\"><\/span><\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">Syntaxe souboru robots.txt je v podstat\u011b jazykov\u00e1 a gramatick\u00e1. <a href=\"https:\/\/seo.london\/cs\/format-a-struktura-clanku\/\">struktura<\/a> pou\u017e\u00edv\u00e1 k vytv\u00e1\u0159en\u00ed sv\u00fdch sm\u011brnic. Je d\u016fle\u017eit\u00e9 pochopit, jak spr\u00e1vn\u00e9 vyu\u017eit\u00ed t\u00e9to syntaxe m\u016f\u017ee pomoci p\u0159i u\u010den\u00ed se blokov\u00e1n\u00ed robot\u016f pomoc\u00ed robots txt.<\/p>\n\n\n\n<ol class=\"wp-block-list\" type=\"1\" start=\"1\">\n<li><strong>User-agent:<\/strong> Sm\u011brnice user-agent ozna\u010duje typ bota, se kter\u00fdm chcete komunikovat, nap\u0159\u00edklad Googlebot pro Google nebo BingBot pro Google. <a href=\"https:\/\/seo.london\/cs\/webove-stranky-nejsou-indexovany-ve-vyhledavani-bings\/\">Bing<\/a>. Sadu direktiv za\u010dn\u011bte pomoc\u00ed \"User-agent: *\" znamen\u00e1, \u017ee v\u0161echny webov\u00e9 prohl\u00ed\u017ee\u010de by m\u011bly db\u00e1t t\u011bchto pokyn\u016f.<\/li>\n\n\n\n<li><strong>Zak\u00e1zat:<\/strong> Tato direktiva vys\u00edl\u00e1 jasnou zpr\u00e1vu - vyhn\u011bte se cest\u011b popsan\u00e9 bezprost\u0159edn\u011b za n\u00ed. \u0158ekn\u011bme, \u017ee kdy\u017e nap\u00ed\u0161ete: \"Zak\u00e1zat: \/images\/\", d\u00e1v\u00e1te t\u00edm pokyn, aby \u017e\u00e1dn\u00fd robot, kter\u00fd ji bude \u010d\u00edst, nem\u011bl mo\u017enost <a href=\"https:\/\/seo.london\/cs\/jetoctopus\/\">prol\u00e9z\u00e1n\u00ed<\/a> va\u0161e webov\u00e9 str\u00e1nky <a href=\"https:\/\/seo.london\/cs\/google-neindexuje-obrazky\/\">obr\u00e1zky<\/a> adres\u00e1\u0159.<\/li>\n\n\n\n<li><strong>Povolit:<\/strong> Zcela opa\u010dn\u011b ne\u017e u p\u0159\u00edkazu disallow, v r\u00e1mci adres\u00e1\u0159\u016f se z\u00e1kazem, p\u0159\u00edkaz allow ud\u011bluje zp\u011bt p\u0159\u00edstupov\u00e1 pr\u00e1va pro ur\u010dit\u00e9 podadres\u00e1\u0159e nebo soubory.<\/li>\n<\/ol>\n\n\n\n<h3 class=\"wp-block-heading\" id=\"h-pattern-matching\"><span class=\"ez-toc-section\" id=\"pattern-matching\"><\/span>Pattern-Matching<span class=\"ez-toc-section-end\"><\/span><\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">Jedn\u00edm ze slo\u017eit\u00fdch, ale \u00fa\u010dinn\u00fdch prvk\u016f syntaxe souboru robots.txt je porovn\u00e1v\u00e1n\u00ed vzor\u016f. Krom\u011b p\u0159\u00edm\u00e9ho zad\u00e1v\u00e1n\u00ed cest umo\u017e\u0148uje porovn\u00e1v\u00e1n\u00ed vzor\u016f formulovat slo\u017eit\u00e9 pokyny k blokov\u00e1n\u00ed robot\u016f v souboru robots txt pomoc\u00ed jednoduch\u00fdch symbol\u016f.<\/p>\n\n\n\n<ol class=\"wp-block-list\" type=\"1\" start=\"1\">\n<li>P\u0159i v\u00fduce porovn\u00e1v\u00e1n\u00ed vzor\u016f se zam\u011b\u0159te p\u0159edev\u0161\u00edm na dva z\u00e1kladn\u00ed znaky - \"*\" (hv\u011bzdi\u010dka) a \"$\" (znak dolaru). Hv\u011bzdi\u010dka slou\u017e\u00ed jako z\u00e1stupn\u00fd znak, zat\u00edmco znak dolaru symbolizuje konec adresy URL.<\/li>\n\n\n\n<li>Pou\u017eit\u00ed hv\u011bzdi\u010dky uvnit\u0159 p\u0159\u00edkazu disallow ozna\u010duje jakoukoli \u0159et\u011bzcovou sekvenci, kter\u00e1 se tam nach\u00e1z\u00ed. Nap\u0159\u00edklad 'Disallow: \/example' zak\u00e1\u017ee webov\u00fdm vyhled\u00e1va\u010d\u016fm p\u0159\u00edstup k jak\u00e9koli str\u00e1nce na va\u0161em webu, kde adresa URL obsahuje 'example'.<\/li>\n\n\n\n<li>Naopak, p\u0159id\u00e1n\u00ed \"$\" na konec va\u0161ich r\u016fzn\u00fdch term\u00edn\u016f ur\u010duje, \u017ee pouze <a href=\"https:\/\/seo.london\/cs\/url-adresy-pratelske-k-vyhledavani\/\">Adresy URL<\/a> kon\u010d\u00ed tak, \u017ee je zak\u00e1z\u00e1no <a href=\"https:\/\/seo.london\/cs\/jaky-je-rozdil-mezi-prochazenim-a-indexovanim-v-seo\/\">prol\u00e9z\u00e1n\u00ed<\/a> roboty. Upozorn\u011bn\u00ed ve zn\u011bn\u00ed \"Zak\u00e1zat: \/*example$' omez\u00ed p\u0159\u00edstup pouze na str\u00e1nky, jejich\u017e adresa URL kon\u010d\u00ed p\u0159esn\u011b na 'example'.<\/li>\n<\/ol>\n\n\n\n<p class=\"wp-block-paragraph\">Nezapome\u0148te v\u0161ak, \u017ee ne v\u0161ichni pavouci t\u011bmto vzor\u016fm rozum\u00ed nebo se jimi \u0159\u00edd\u00ed - p\u0159edev\u0161\u00edm mnoz\u00ed spamov\u011b orientovan\u00ed -, tak\u017ee to berte v \u00favahu p\u0159i sestavov\u00e1n\u00ed sm\u011brnic a hled\u00e1n\u00ed \u00fa\u010dinn\u00fdch zp\u016fsob\u016f, jak \u00fa\u010dinn\u011b blokovat roboty pomoc\u00ed soubor\u016f robots txt.\"\"\"\"<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Um\u00edst\u011bn\u00ed souboru robots.txt se m\u016f\u017ee zd\u00e1t n\u00e1ro\u010dn\u00e9, ale m\u016f\u017eete si b\u00fdt jisti, \u017ee jde o pom\u011brn\u011b jednoduch\u00fd proces. Tento mal\u00fd, ale z\u00e1sadn\u00ed dokument pat\u0159\u00ed na jedno p\u0159esn\u00e9 m\u00edsto - do ko\u0159enov\u00e9ho adres\u00e1\u0159e va\u0161eho webu.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Z\u00e1sadn\u00ed v\u011bc\u00ed, kterou je t\u0159eba m\u00edt na pam\u011bti, je, \u017ee tento jednoduch\u00fd textov\u00fd soubor mus\u00ed b\u00fdt snadno nalezen vyhled\u00e1va\u010di. Do ko\u0159enov\u00e9ho adres\u00e1\u0159e nebo do nejvy\u0161\u0161\u00edho adres\u00e1\u0159e se obvykle nejprve pod\u00edvaj\u00ed roboti vyhled\u00e1va\u010d\u016f. <a href=\"https:\/\/seo.london\/cs\/jsou-vstupni-stranky-spatne-pro-seo\/\">p\u0159ist\u00e1n\u00ed<\/a> na va\u0161em <a href=\"https:\/\/seo.london\/cs\/vyhody-a-nevyhody-domeny-presne-shody\/\">dom\u00e9na<\/a>. Um\u00edst\u011bn\u00ed souboru robots.txt zde tedy poskytuje okam\u017eit\u00e9 a jasn\u00e9 pokyny, kter\u00e9 \u010d\u00e1sti webu maj\u00ed b\u00fdt p\u0159\u00edstupn\u00e9.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Ti, kte\u0159\u00ed se ve webov\u00e9 mluv\u011b nevyznaj\u00ed, se mo\u017en\u00e1 ptaj\u00ed, co p\u0159esn\u011b m\u00e1me na mysli, kdy\u017e mluv\u00edme o ko\u0159enov\u00e9m adres\u00e1\u0159i. Ko\u0159enov\u00fd adres\u00e1\u0159 va\u0161eho webu je v podstat\u011b n\u011bco jako kmen stromu, ze kter\u00e9ho vych\u00e1zej\u00ed v\u0161echny ostatn\u00ed adres\u00e1\u0159e - tvo\u0159\u00ed p\u00e1te\u0159 va\u0161\u00ed online prezentace. Pokud je nap\u0159\u00edklad adresa URL va\u0161eho webu www.example.com, pak ko\u0159enov\u00fd adres\u00e1\u0159 bude \/ (lom\u00edtko za .com). Adresa www.example.com\/robots.txt tedy dokonale ozna\u010duje sv\u00e9 m\u00edsto v ko\u0159enov\u00e9m adres\u00e1\u0159i.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Naproti tomu um\u00edst\u011bn\u00ed pod jinou <a href=\"https:\/\/seo.london\/cs\/blog-na-subdomene-nebo-podadresari\/\">podadres\u00e1\u0159<\/a> jako je \/blog\/robots.txt, nebude m\u00edt po\u017eadovan\u00fd \u00fa\u010dinek, proto\u017ee roboti se nebudou obt\u011b\u017eovat hledat tak daleko na va\u0161ich str\u00e1nk\u00e1ch, ne\u017e z\u00edskaj\u00ed pokyny.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Nespr\u00e1vn\u00e9 um\u00edst\u011bn\u00ed by mohlo v\u00e9st k neefektivn\u00edmu proch\u00e1zen\u00ed a indexov\u00e1n\u00ed - dv\u011bma z\u00e1kladn\u00edm faktor\u016fm p\u0159i <a href=\"https:\/\/seo.london\/cs\/\">SEO<\/a> \u00fasp\u011bch - proto\u017ee vyhled\u00e1va\u010de nebudou v\u011bd\u011bt, kde maj\u00ed povoleno nebo zak\u00e1z\u00e1no zkoumat, kdy\u017e se dostanou na \"v\u00e1\u0161 pr\u00e1h\".<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Proto se ujist\u011bte, \u017ee m\u00e1te um\u00edst\u011bn\u00ed p\u0159ibit\u00e9, kdy\u017e se d\u00edv\u00e1te na to, jak efektivn\u011b blokovat roboty pomoc\u00ed soubor\u016f robots txt. Um\u00edst\u011bn\u00ed hraje v tomto z\u00e1kladn\u00edm technick\u00e9m nastaven\u00ed SEO skute\u010dn\u011b ned\u00edlnou roli.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">P\u0159i pochopen\u00ed v\u00fdznamu a fungov\u00e1n\u00ed soubor\u016f robots.txt z\u016fst\u00e1v\u00e1 jedna relevantn\u00ed ot\u00e1zka: pro\u010d pot\u0159ebujete soubor robots.txt?<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Za prv\u00e9, soubor robots.txt poskytuje webov\u00fdm prohl\u00ed\u017ee\u010d\u016fm pokyny, jak maj\u00ed s va\u0161imi webov\u00fdmi str\u00e1nkami pracovat. Kdy\u017e vyhled\u00e1va\u010de p\u0159istupuj\u00ed k va\u0161emu webu, aby jej indexovaly, tyto pokyny v souboru robots.txt vstupuj\u00ed do hry. Nav\u00e1d\u011bj\u00ed vyhled\u00e1vac\u00ed roboty, jako je Googlebot spole\u010dnosti Google nebo Bingbot spole\u010dnosti Bing, na jejich naviga\u010dn\u00ed cesty po va\u0161\u00ed dom\u00e9n\u011b.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Za druh\u00e9, soubor robots.txt je nezbytn\u00fd pro spr\u00e1vu p\u0159\u00edstupu do soukrom\u00fdch \u010d\u00e1st\u00ed webu, kter\u00e9 jsou citliv\u00e9 nebo se na nich pracuje. Robot\u016fm m\u016f\u017eete v\u00fdslovn\u011b na\u0159\u00eddit, aby <a href=\"https:\/\/seo.london\/cs\/jak-primet-google-aby-rychleji-indexoval-vase-stranky\/\">indexov\u00e1n\u00ed<\/a> takov\u00fd obsah. T\u00edm se zajist\u00ed, \u017ee ne\u017e\u00e1douc\u00ed oblasti z\u016fstanou neindexovan\u00e9 a mimo dohled ve\u0159ejnosti prost\u0159ednictv\u00edm str\u00e1nek v\u00fdsledk\u016f vyhled\u00e1v\u00e1n\u00ed (SERP).<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Na webu nav\u00edc existuje nespo\u010det prol\u00e9zac\u00edch robot\u016f, a to jak dobr\u00fdch, tak \u0161kodliv\u00fdch. T\u00edm, \u017ee v souboru robots.txt nastav\u00edte, kdo m\u016f\u017ee co na va\u0161em webu proch\u00e1zet, pomoc\u00ed specifick\u00fdch p\u0159\u00edkaz\u016f \"User-agent\", udr\u017e\u00edte vysok\u00e9 standardy ochrany p\u0159ed potenci\u00e1ln\u00edmi hrozbami, kter\u00e9 v\u00e1s nav\u0161t\u011bvuj\u00ed pod rou\u0161kou nevinn\u00e9ho proch\u00e1zen\u00ed.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">A kone\u010dn\u011b, bez omezen\u00ed stanoven\u00fdch v souboru Robots txt mohou n\u011bkte\u0159\u00ed roboti p\u0159et\u00ed\u017eit servery t\u00edm, \u017ee je zahlt\u00ed po\u017eadavky, co\u017e vede ke zpomalen\u00ed u\u017eivatel\u016f. <a href=\"https:\/\/seo.london\/cs\/co-jsou-signaly-zkusenosti-se-strankami\/\">zku\u0161enosti<\/a> nebo \u00fatoky DDoS (Distributed Denial of Service). Funguje tedy jako d\u016fle\u017eit\u00fd n\u00e1stroj pro zaji\u0161t\u011bn\u00ed optim\u00e1ln\u00edho v\u00fdkonu. <a href=\"https:\/\/seo.london\/cs\/vykreslovani-na-strane-serveru-vs-na-strane-klienta\/\">server<\/a> <a href=\"https:\/\/seo.london\/cs\/znalostni-baze\/jak-monitorovat-vykon\/\">v\u00fdkon<\/a>.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">A\u017e se za\u010dnete seznamovat se strukturov\u00e1n\u00edm vlastn\u00edho souboru Robots txt v dal\u0161\u00edch \u010d\u00e1stech tohoto \u010dl\u00e1nku, nezapome\u0148te na tento kl\u00ed\u010dov\u00fd koncept: Proto je pro ochranu a optimalizaci p\u0159\u00edtomnosti jak\u00e9koli dom\u00e9ny na internetu z\u00e1sadn\u00ed m\u00edt konkr\u00e9tn\u00ed soubor Robots txt.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"h-checking-if-you-have-a-robots-txt-file\"><span class=\"ez-toc-section\" id=\"checking-if-you-have-a-robotstxt-file\"><\/span>Kontrola, zda m\u00e1te soubor robots.txt<span class=\"ez-toc-section-end\"><\/span><\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">P\u0159ejd\u011bme nyn\u00ed k tomu, jak m\u016f\u017eete zjistit, zda va\u0161e webov\u00e9 str\u00e1nky ji\u017e maj\u00ed soubor robots.txt. Obecn\u011b se nach\u00e1z\u00ed v ko\u0159enov\u00e9m adres\u00e1\u0159i va\u0161eho webu.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Chcete-li zkontrolovat jeho p\u0159\u00edtomnost, doporu\u010duji n\u00e1sleduj\u00edc\u00ed jednoduch\u00e9 kroky:<\/p>\n\n\n\n<ol class=\"wp-block-list\" type=\"1\" start=\"1\">\n<li>Otev\u0159ete sv\u016fj obl\u00edben\u00fd webov\u00fd prohl\u00ed\u017ee\u010d.<\/li>\n\n\n\n<li>V <a href=\"https:\/\/seo.london\/cs\/mistni-vyhledavani-bez-fyzicke-adresy\/\">adresa<\/a> baru v <a href=\"https:\/\/seo.london\/cs\/seo-agentura-v-londyne\/\">top<\/a>, zadejte yoursitename.com\/robots.txt; nahra\u010fte \"yoursitename.com\" sv\u00fdm skute\u010dn\u00fdm n\u00e1zvem dom\u00e9ny.<\/li>\n<\/ol>\n\n\n\n<p class=\"wp-block-paragraph\">Na obrazovce by se m\u011bl zobrazit obsah tohoto nen\u00e1padn\u00e9ho, ale vlivn\u00e9ho souboru robots.txt, pokud na va\u0161em webu existuje. Naopak chybov\u00e1 zpr\u00e1va podobn\u00e1 \"str\u00e1nka 404 nenalezena\" nebo \"soubor nenalezen\" by znamenala, \u017ee soubor robots.txt v sou\u010dasn\u00e9 dob\u011b neexistuje.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Nezapome\u0148te, \u017ee spr\u00e1vn\u011b implementovat 'jak blokovat roboty robot\u016f txt' <a href=\"https:\/\/seo.london\/cs\/londynska-seo-strategie\/\">strategie<\/a> v\u00fdznamn\u011b ovliv\u0148uje optimalizaci pro vyhled\u00e1va\u010de (SEO). Proto je d\u016fle\u017eit\u00e9, abyste byli informov\u00e1ni o tom, zda ho m\u00e1te, nebo ne.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Souhrnn\u011b (i kdy\u017e ne povinn\u011b) lze \u0159\u00edci, \u017ee pochopen\u00ed a spr\u00e1vn\u00e9 pou\u017e\u00edv\u00e1n\u00ed souboru robots.txt je dnes ned\u00edlnou sou\u010d\u00e1st\u00ed spr\u00e1vy \u00fasp\u011b\u0161n\u00fdch webov\u00fdch str\u00e1nek. Pokud si po proveden\u00ed t\u011bchto krok\u016f pro kontrolu jeho existence st\u00e1le nejste jisti, zva\u017ete mo\u017enost nechat si poradit od odborn\u00edka, proto\u017ee m\u016f\u017ee j\u00edt o pokro\u010dilej\u0161\u00ed IT. <a href=\"https:\/\/seo.london\/cs\/jak-pouzivat-znalostni-graf-google\/\">znalosti<\/a> ne\u017e se o\u010dek\u00e1valo.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Nezapome\u0148te tak\u00e9, \u017ee absence souboru robots.txt nemus\u00ed b\u00fdt nutn\u011b na \u0161kodu - znamen\u00e1 pouze neomezen\u00fd p\u0159\u00edstup robot\u016f vyhled\u00e1va\u010d\u016f do v\u0161ech oblast\u00ed va\u0161eho webu. Smyslupln\u00e1 kontrola nad takov\u00fdm p\u0159\u00edstupem se stane zcela mo\u017enou, jakmile pochop\u00edme, \"jak efektivn\u011b blokovat roboty robots txt\" na na\u0161ich str\u00e1nk\u00e1ch!<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"h-how-to-create-a-robots-txt-file\"><span class=\"ez-toc-section\" id=\"how-to-create-a-robotstxt-file\"><\/span>Jak vytvo\u0159it soubor Robots.txt<span class=\"ez-toc-section-end\"><\/span><\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">Vytvo\u0159en\u00ed souboru robots.txt je z\u00e1kladn\u00edm krokem p\u0159i \u0159\u00edzen\u00ed interakce robot\u016f vyhled\u00e1va\u010d\u016f s va\u0161imi webov\u00fdmi str\u00e1nkami. Poj\u010fme se pono\u0159it do procesu jeho vytv\u00e1\u0159en\u00ed.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\" id=\"h-understanding-the-components-of-robots-txt\"><span class=\"ez-toc-section\" id=\"understanding-the-components-of-robotstxt\"><\/span>Porozum\u011bn\u00ed sou\u010d\u00e1stem souboru Robots.txt<span class=\"ez-toc-section-end\"><\/span><\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">Typick\u00fd soubor robots.txt obsahuje dv\u011b hlavn\u00ed sou\u010d\u00e1sti, v\u010detn\u011b direktiv User-agent a Disallow. User-agent odkazuje na konkr\u00e9tn\u00ed webov\u00fd crawler, jako je Googlebot nebo Bingbot, na kter\u00fd maj\u00ed b\u00fdt va\u0161e pokyny zam\u011b\u0159eny. Na druhou stranu ve sm\u011brnici Disallow jsou uvedeny str\u00e1nky nebo adres\u00e1\u0159e, kter\u00e9 nechcete, aby ur\u010dit\u00e9 roboty proch\u00e1zely. Nap\u0159\u00edklad:<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">User-agent: * Zak\u00e1zat: \/private\/<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">V tomto p\u0159\u00edpad\u011b je v\u0161em bot\u016fm (\"*\" znamen\u00e1 v\u0161echny) zablokov\u00e1n p\u0159\u00edstup k \u010demukoli v adres\u00e1\u0159i \"private\".<\/p>\n\n\n\n<h3 class=\"wp-block-heading\" id=\"h-fresh-file-generation\"><span class=\"ez-toc-section\" id=\"fresh-file-generation\"><\/span>Generov\u00e1n\u00ed \u010derstv\u00fdch soubor\u016f<span class=\"ez-toc-section-end\"><\/span><\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">Nyn\u00ed p\u0159ejdeme k vygenerov\u00e1n\u00ed tohoto \u0161ikovn\u00e9ho k\u00f3du. Budete pot\u0159ebovat oby\u010dejn\u00fd textov\u00fd editor - posta\u010d\u00ed v\u00e1m Notepad. Textov\u00e9 procesory, jako je Microsoft Word, nejsou pro tento \u00fakol vhodn\u00e9 kv\u016fli jejich tendenci vkl\u00e1dat dodate\u010dn\u00e9 form\u00e1tovac\u00ed znaky.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Na za\u010d\u00e1tku vytvo\u0159te nov\u00fd dokument a ulo\u017ete jej jako \"robots.txt\". M\u011bjte na pam\u011bti, \u017ee zde z\u00e1le\u017e\u00ed na psan\u00ed velk\u00fdch p\u00edsmen - dbejte na to, aby v\u0161e bylo ps\u00e1no mal\u00fdmi p\u00edsmeny. D\u00e1le n\u00e1sleduje tvorba syntaxe podle toho, kter\u00e9 sekce chcete blokovat. Nezapome\u0148te, \u017ee ka\u017ed\u00e9 pravidlo by m\u011blo b\u00fdt na samostatn\u00e9m \u0159\u00e1dku:<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">User-agent: * Zak\u00e1zat: \/<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Toto pravidlo zakazuje v\u0161em bot\u016fm p\u0159\u00edstup k jak\u00e9koli \u010d\u00e1sti va\u0161eho webu (ozna\u010den\u00e9 znakem '\/'). Pou\u017e\u00edvejte jej s rozvahou!<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Na str\u00e1nk\u00e1ch <a href=\"https:\/\/seo.london\/cs\/co-jsou-meta-klicova-slova\/\">kl\u00ed\u010dov\u00e9 slovo<\/a> zde je specifi\u010dnost; kdy\u017e se u\u010d\u00edte blokovat roboty, moduly robots txt jsou univerz\u00e1ln\u00edmi n\u00e1stroji, kter\u00e9 umo\u017e\u0148uj\u00ed p\u0159esnou kontrolu nad akcemi bot\u016f.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\" id=\"h-uploading-your-file\"><span class=\"ez-toc-section\" id=\"uploading-your-file\"><\/span>Nahr\u00e1v\u00e1n\u00ed soubor\u016f<span class=\"ez-toc-section-end\"><\/span><\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">Po vytvo\u0159en\u00ed nahrajte soubor robots.txt do ko\u0159enov\u00e9 slo\u017eky webu pomoc\u00ed protokolu FTP (File Transfer Protocol). Obvykle se nach\u00e1z\u00ed ve stejn\u00e9m um\u00edst\u011bn\u00ed jako slo\u017eky wp-admin, wp-content a wp-includes.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Po \u00fasp\u011b\u0161n\u00e9m dokon\u010den\u00ed t\u011bchto krok\u016f mohou u\u017eivatel\u00e9 naj\u00edt v\u00e1\u0161 soubor Robots.txt tak, \u017ee za va\u0161i prim\u00e1rn\u00ed dom\u00e9nu - nap\u0159. www.example.com\/robots.txt - p\u0159ipoj\u00ed \"\/robots.txt\". Nyn\u00ed jste zvl\u00e1dli vytvo\u0159it soubor robots.txt!<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Nezapome\u0148te v\u0161ak, \u017ee zat\u00edmco poctiv\u00e9 crawlery \u00fa\u010dinn\u011b usm\u011br\u0148uje pouze zdvo\u0159ilost, mazan\u011bj\u0161\u00ed destruktivn\u00ed roboti se mohou rozhodnout je rovnou ignorovat.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Po z\u00edsk\u00e1n\u00ed t\u011bchto znalost\u00ed m\u011bjte na pam\u011bti, \u017ee \u00fadr\u017eba je nezbytn\u00e1 - pravideln\u00e1 kontrola zaji\u0161\u0165uje trvalou \u00fa\u010dinnost, proto si vyhra\u010fte \u010das na pravideln\u00e9 kontroly. \u0160\u0165astn\u00e9 k\u00f3dov\u00e1n\u00ed!<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"h-blocking-specific-bots-and-files-folders\"><span class=\"ez-toc-section\" id=\"blocking-specific-bots-and-filesfolders\"><\/span>Blokov\u00e1n\u00ed konkr\u00e9tn\u00edch bot\u016f a soubor\u016f\/slo\u017eek<span class=\"ez-toc-section-end\"><\/span><\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">P\u0159i pronik\u00e1n\u00ed do t\u00e9matu - jak blokovat roboty robot\u016f txt, je d\u016fle\u017eit\u00e9 si uv\u011bdomit, \u017ee tento \u00fakol nen\u00ed v\u017edy o omezen\u00ed v\u0161ech crawler\u016f. \u010casto m\u016f\u017eete cht\u00edt ur\u010dit pouze ur\u010dit\u00e9 ne\u017e\u00e1douc\u00ed roboty nebo omezit p\u0159\u00edstup pouze k ur\u010dit\u00fdm soubor\u016fm a adres\u00e1\u0159\u016fm. V t\u011bchto nuancovan\u00fdch sc\u00e9n\u00e1\u0159\u00edch m\u016f\u017ee m\u00edt v\u011bt\u0161\u00ed porozum\u011bn\u00ed manipulaci se souborem robots.txt z\u00e1sadn\u00ed v\u00fdznam.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Jednota v rozmanitosti je roz\u0161\u00ed\u0159en\u00e1 taktika, kterou pou\u017e\u00edvaj\u00ed r\u016fzn\u00e9 online slu\u017eby. R\u016fzn\u00e9 typy webov\u00fdch crawler\u016f se pohybuj\u00ed kolem <a href=\"https:\/\/seo.london\/cs\/seo-pro-it-spolecnosti\/\">internet<\/a> s r\u016fzn\u00fdm chov\u00e1n\u00edm a schopnostmi. Zat\u00edmco n\u011bkte\u0159\u00ed pavouci jsou pro indexov\u00e1n\u00ed obsahu nezbytn\u00ed, jako nap\u0159\u00edklad Googlebot, jin\u00ed, nap\u0159\u00edklad spamov\u00ed roboti, mohou po\u0161kodit v\u00fdkonnost va\u0161eho webu.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Tyto m\u00e9n\u011b konstruktivn\u00ed roboty lze blokovat dv\u011bma zp\u016fsoby: \u00fazce nebo \u0161iroce. \u00dazk\u00fd p\u0159\u00edstup znamen\u00e1 zablokov\u00e1n\u00ed konkr\u00e9tn\u00edho bota na cel\u00e9m webu, zat\u00edmco \u0161ir\u0161\u00ed p\u0159\u00edstup zahrnuje zablokov\u00e1n\u00ed ka\u017ed\u00e9ho bota v ur\u010dit\u00e9 slo\u017ece nebo souboru.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Ne\u017e budeme pokra\u010dovat, pochop\u00edme, jak m\u016f\u017eete v souboru robots.txt zadat agenta u\u017eivatele (tj. bota). Ka\u017ed\u00e9 pravidlo v tomto dokumentu mus\u00ed za\u010d\u00ednat uveden\u00edm \"User-agent\", za n\u00edm\u017e n\u00e1sleduje dvojte\u010dka(:) a pot\u00e9 vymezen\u00ed jm\u00e9na agenta. Ponech\u00e1n\u00ed hv\u011bzdi\u010dky (*) znamen\u00e1, \u017ee str\u00e1nku nav\u0161t\u00edv\u00ed jak\u00fdkoli bot. M\u00edsto toho se lze rozhodnout pro zad\u00e1n\u00ed konkr\u00e9tn\u00edch jmen ur\u010dit\u00fdch bot\u016f.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">D\u00e1le n\u00e1sleduj\u00ed direktivy \"Zak\u00e1zat\" nebo \"Povolit\", kter\u00e9 ur\u010duj\u00ed povolen\u00e9 akce pro identifikovan\u00e9 u\u017eivatele-agenty t\u00fdkaj\u00edc\u00ed se konkr\u00e9tn\u00edch oblast\u00ed va\u0161ich webov\u00fdch str\u00e1nek.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Nezapome\u0148te, \u017ee d\u016fle\u017eit\u00e9 je nejen v\u011bd\u011bt, jak roboty txt blokovat, ale tak\u00e9 pro\u010d - zam\u011b\u0159it se jak na prevenci pl\u00fdtv\u00e1n\u00ed prost\u0159edky, tak na ochranu p\u0159ed \u0161kodliv\u00fdmi aktivitami kompromitovan\u00fdch agent\u016f.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Na z\u00e1v\u011br na\u0161\u00ed diskuse o specifick\u00fdch aspektech blokov\u00e1n\u00ed nezapome\u0148te, \u017ee p\u0159i vkl\u00e1d\u00e1n\u00ed d\u016fv\u011bry v dodr\u017eov\u00e1n\u00ed t\u011bchto pravidel hraje v\u00fdznamnou roli spolehlivost - hlavn\u00ed vyhled\u00e1va\u010de je obvykle striktn\u011b dodr\u017euj\u00ed, bohu\u017eel m\u00e9n\u011b zn\u00e1m\u00ed scraper-boti je dodr\u017euj\u00ed jen z\u0159\u00eddka. Pokud se sna\u017e\u00edte zabezpe\u010dit citliv\u00e1 data, nespol\u00e9hejte se pouze na robots.txt!<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"h-robots-txt-vs-meta-robots-vs-x-robots\"><span class=\"ez-toc-section\" id=\"robotstxt-vs-meta-robots-vs-x-robots\"><\/span>Robots.txt vs Meta Robots vs X-Robots<span class=\"ez-toc-section-end\"><\/span><\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">Znalost blokov\u00e1n\u00ed bot\u016f pomoc\u00ed robots txt je z\u00e1sadn\u00ed, ale nen\u00ed to jedin\u00e1 metoda kontroly chov\u00e1n\u00ed bot\u016f na va\u0161ich webov\u00fdch str\u00e1nk\u00e1ch. Existuj\u00ed tak\u00e9 <a href=\"https:\/\/seo.london\/cs\/meta-description-title-tag-h1-na-strance-kontaktu\/\">meta<\/a> zna\u010dek robots a x-robots, co\u017e jsou dal\u0161\u00ed dva \u00fa\u010dinn\u00e9 zp\u016fsoby, jak d\u00e1t online robot\u016fm instrukce o va\u0161em webu. Pokud p\u0159em\u00fd\u0161l\u00edte, kter\u00fd z nich pou\u017e\u00edt nebo \u010d\u00edm se li\u0161\u00ed od ostatn\u00edch, vysv\u011btl\u00edm v\u00e1m to.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\" id=\"h-the-robots-txt-file\"><span class=\"ez-toc-section\" id=\"the-robotstxt-file\"><\/span>Soubor Robots.txt<span class=\"ez-toc-section-end\"><\/span><\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">Jak jsme ji\u017e uvedli, soubor robots.txt slou\u017e\u00ed jako hlavn\u00ed vod\u00edtko pro spr\u00e1vce webu, kter\u00fd m\u016f\u017ee vyhled\u00e1va\u010de nasm\u011brovat na ur\u010dit\u00e9 \u010d\u00e1sti webu nebo od nich odklonit. Tento mal\u00fd textov\u00fd soubor se nach\u00e1z\u00ed na \u00farovni ko\u0159enov\u00e9ho adres\u00e1\u0159e a obvykle obsahuje obecn\u00e9 pokyny pro v\u0161echny roboty u\u017eivatelsk\u00fdch agent\u016f, pokud nejsou zd\u016frazn\u011bny konkr\u00e9tn\u00ed.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Soubor robots.txt v podstat\u011b \u0159\u00edk\u00e1 robot\u016fm: \"Tyto oblasti jsou zak\u00e1z\u00e1ny.\" Uv\u011bdomte si v\u0161ak, \u017ee ne v\u0161ichni pavouci tato pravidla respektuj\u00ed.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\" id=\"h-what-are-meta-robots-tags\"><span class=\"ez-toc-section\" id=\"what-are-meta-robots-tags\"><\/span>Co jsou meta zna\u010dky robot\u016f?<span class=\"ez-toc-section-end\"><\/span><\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">Zna\u010dky Meta Robots nab\u00edzej\u00ed podrobn\u011bj\u0161\u00ed ovl\u00e1d\u00e1n\u00ed ve srovn\u00e1n\u00ed se zna\u010dkami <a href=\"https:\/\/seo.london\/cs\/globalni-vyhledavani\/\">\u0161irok\u00fd<\/a> pokyny uveden\u00e9 v souboru robots.txt. Tyto atributy HTML d\u00e1vaj\u00ed robot\u016fm vyhled\u00e1va\u010d\u016f pokyny k indexov\u00e1n\u00ed jednotliv\u00fdch str\u00e1nek, nikoli cel\u00fdch adres\u00e1\u0159\u016f nebo web\u016f. \u0158\u00edkaj\u00ed vyhled\u00e1va\u010d\u016fm, zda maj\u00ed str\u00e1nku indexovat (\"noindex\"), sledovat jej\u00ed odkazy (\"nofollow\"), \"none\" (co\u017e znamen\u00e1 noindex a <a href=\"https:\/\/seo.london\/cs\/mel-bych-pouzivat-atribut-nofollow-pro-interni-odkazy\/\">nofollow<\/a>) a dal\u0161\u00ed p\u0159\u00edkazy. Metazna\u010dky robot\u016f komunikuj\u00ed p\u0159\u00edmo s vyhled\u00e1va\u010di po jednotliv\u00fdch str\u00e1nk\u00e1ch a nab\u00edzej\u00ed skute\u010dnou v\u0161estrannost p\u0159i \u0159\u00edzen\u00ed chov\u00e1n\u00ed vyhled\u00e1va\u010d\u016f.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\" id=\"h-how-do-x-robots-tags-work\"><span class=\"ez-toc-section\" id=\"how-do-x-robots-tags-work\"><\/span>Jak funguj\u00ed \u0161t\u00edtky X-Robots?<span class=\"ez-toc-section-end\"><\/span><\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">Zna\u010dky X-Robots maj\u00ed n\u011bkter\u00e9 spole\u010dn\u00e9 rysy se zna\u010dkami meta robots, proto\u017ee tak\u00e9 poskytuj\u00ed podrobn\u00e9 pokyny na \u00farovni str\u00e1nky. Na rozd\u00edl od sv\u00fdch prot\u011bj\u0161k\u016f, kter\u00e9 se objevuj\u00ed v dokumentech HTML, se v\u0161ak zna\u010dky x-robots nach\u00e1zej\u00ed v dokumentu HTML. <a href=\"https:\/\/seo.london\/cs\/co-je-smiseny-obsah\/\">HTTP<\/a> z\u00e1hlav\u00ed.  Toto um\u00edst\u011bn\u00ed umo\u017e\u0148uje, aby fungovaly i pro soubory, kter\u00e9 nejsou v jazyce HTML, jako jsou soubory PDF nebo obr\u00e1zky. Stejn\u011b jako u metazna\u010dek robot\u016f se v\u0161ak akce zna\u010dek x-robot pohybuj\u00ed od \"noindex\", \"nofollow\" nebo dokonce \"nosnippet\" a dal\u0161\u00edch.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">I kdy\u017e je tedy znalost blokov\u00e1n\u00ed robot\u016f pomoc\u00ed robots txt skute\u010dn\u011b cennou znalost\u00ed pro ka\u017ed\u00e9ho webmastera, pochopen\u00ed siln\u00fdch str\u00e1nek a aplikac\u00ed metarobot\u016f a x-robot\u016f poskytuje je\u0161t\u011b \u0161ir\u0161\u00ed sadu n\u00e1stroj\u016f p\u0159i \u00faprav\u011b vztahu va\u0161ich str\u00e1nek s webov\u00fdmi crawlery.<\/p>","protected":false},"excerpt":{"rendered":"<p>Neinformovan\u00e9mu pozorovateli m\u016f\u017ee robot, kter\u00fd se potuluje po va\u0161ich webov\u00fdch str\u00e1nk\u00e1ch, p\u0159ipadat jako z n\u011bjak\u00e9ho sci-fi filmu. V\u011b\u0159te tomu nebo ne, ale k fikci to m\u00e1 daleko a je to bl\u00ed\u017e realit\u011b, ne\u017e si mysl\u00edte! Pro ka\u017ed\u00e9ho, kdo se pohybuje v ter\u00e9nu vlastnictv\u00ed a \u00fadr\u017eby webov\u00fdch str\u00e1nek, je z\u00e1sadn\u00ed pochopit, jak roboti interaguj\u00ed s na\u0161\u00edm online prostorem. [...]<\/p>","protected":false},"author":6,"featured_media":31181,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[14],"tags":[],"class_list":["post-31157","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-seo"],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO Premium plugin v20.9 (Yoast SEO v26.4) - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>How to Block Bots with Robots.txt? - SEO.London<\/title>\n<meta name=\"description\" content=\"A robots.txt file is essentially the gatekeeper of your website. It allows you to control which parts of your site are available for bot exploration\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/seo.london\/cs\/jak-blokovat-roboty-pomoci-robots-txt\/\" \/>\n<meta property=\"og:locale\" content=\"cs_CZ\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"How to Block Bots with Robots.txt?\" \/>\n<meta property=\"og:description\" content=\"For an uninformed observer, a robot wandering around your website might seem like something out of a sci-fi movie. Believe it or not, it&#039;s far from\" \/>\n<meta property=\"og:url\" content=\"https:\/\/seo.london\/cs\/jak-blokovat-roboty-pomoci-robots-txt\/\" \/>\n<meta property=\"og:site_name\" content=\"SEO.London\" \/>\n<meta property=\"article:published_time\" content=\"2023-06-12T12:01:52+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2023-06-29T16:47:23+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/seo.london\/wp-content\/uploads\/2023\/06\/How-to-Block-Bots-with-Robots.png\" \/>\n\t<meta property=\"og:image:width\" content=\"800\" \/>\n\t<meta property=\"og:image:height\" content=\"449\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"author\" content=\"Lukasz Zelezny\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Napsal(a)\" \/>\n\t<meta name=\"twitter:data1\" content=\"Lukasz Zelezny\" \/>\n\t<meta name=\"twitter:label2\" content=\"Odhadovan\u00e1 doba \u010dten\u00ed\" \/>\n\t<meta name=\"twitter:data2\" content=\"11 minut\" \/>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"Jak blokovat roboty pomoc\u00ed souboru Robots.txt? - SEO.London","description":"Soubor robots.txt je v podstat\u011b str\u00e1\u017ecem va\u0161eho webu. Umo\u017e\u0148uje \u0159\u00eddit, kter\u00e9 \u010d\u00e1sti webu jsou dostupn\u00e9 pro pr\u016fzkum bot\u016f.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/seo.london\/cs\/jak-blokovat-roboty-pomoci-robots-txt\/","og_locale":"cs_CZ","og_type":"article","og_title":"How to Block Bots with Robots.txt?","og_description":"For an uninformed observer, a robot wandering around your website might seem like something out of a sci-fi movie. Believe it or not, it's far from","og_url":"https:\/\/seo.london\/cs\/jak-blokovat-roboty-pomoci-robots-txt\/","og_site_name":"SEO.London","article_published_time":"2023-06-12T12:01:52+00:00","article_modified_time":"2023-06-29T16:47:23+00:00","og_image":[{"width":800,"height":449,"url":"https:\/\/seo.london\/wp-content\/uploads\/2023\/06\/How-to-Block-Bots-with-Robots.png","type":"image\/png"}],"author":"Lukasz Zelezny","twitter_card":"summary_large_image","twitter_misc":{"Napsal(a)":"Lukasz Zelezny","Odhadovan\u00e1 doba \u010dten\u00ed":"11 minut"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/seo.london\/fi\/how-to-block-bots-with-robots-txt\/","url":"https:\/\/seo.london\/how-to-block-bots-with-robots-txt\/","name":"Jak blokovat roboty pomoc\u00ed souboru Robots.txt? - SEO.London","isPartOf":{"@id":"https:\/\/seo.london\/fi\/#website"},"primaryImageOfPage":{"@id":"https:\/\/seo.london\/how-to-block-bots-with-robots-txt\/#primaryimage"},"image":{"@id":"https:\/\/seo.london\/how-to-block-bots-with-robots-txt\/#primaryimage"},"thumbnailUrl":"https:\/\/seo.london\/wp-content\/uploads\/2023\/06\/How-to-Block-Bots-with-Robots.png","datePublished":"2023-06-12T12:01:52+00:00","dateModified":"2023-06-29T16:47:23+00:00","author":{"@id":"https:\/\/seo.london\/fi\/#\/schema\/person\/a87f13cbf62c630a697ac094314f9e25"},"description":"Soubor robots.txt je v podstat\u011b str\u00e1\u017ecem va\u0161eho webu. Umo\u017e\u0148uje \u0159\u00eddit, kter\u00e9 \u010d\u00e1sti webu jsou dostupn\u00e9 pro pr\u016fzkum bot\u016f.","breadcrumb":{"@id":"https:\/\/seo.london\/how-to-block-bots-with-robots-txt\/#breadcrumb"},"inLanguage":"cs","potentialAction":[{"@type":"ReadAction","target":["https:\/\/seo.london\/how-to-block-bots-with-robots-txt\/"]}]},{"@type":"ImageObject","inLanguage":"cs","@id":"https:\/\/seo.london\/how-to-block-bots-with-robots-txt\/#primaryimage","url":"https:\/\/seo.london\/wp-content\/uploads\/2023\/06\/How-to-Block-Bots-with-Robots.png","contentUrl":"https:\/\/seo.london\/wp-content\/uploads\/2023\/06\/How-to-Block-Bots-with-Robots.png","width":800,"height":449,"caption":"How to Block Bots with Robots.txt"},{"@type":"BreadcrumbList","@id":"https:\/\/seo.london\/how-to-block-bots-with-robots-txt\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/seo.london\/fr\/"},{"@type":"ListItem","position":2,"name":"How to Block Bots with Robots.txt?"}]},{"@type":"WebSite","@id":"https:\/\/seo.london\/fi\/#website","url":"https:\/\/seo.london\/fi\/","name":"SEO.London","description":"SEO konzultant a odborn\u00e1 firma v Lond\u00fdn\u011b, Velk\u00e1 Brit\u00e1nie - Lukasz Zelezny","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/seo.london\/fi\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"cs"},{"@type":"Person","@id":"https:\/\/seo.london\/fi\/#\/schema\/person\/a87f13cbf62c630a697ac094314f9e25","name":"Lukasz Zelezny","image":{"@type":"ImageObject","inLanguage":"cs","@id":"https:\/\/seo.london\/fi\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/55d18e132c3d0d63f7cd047da2d2a7f805a3392a84a615be5d6dca867281758e?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/55d18e132c3d0d63f7cd047da2d2a7f805a3392a84a615be5d6dca867281758e?s=96&d=mm&r=g","caption":"Lukasz Zelezny"},"description":"#1 SEO konzultant \u017eij\u00edc\u00ed v Lond\u00fdn\u011b, kter\u00fd spolupracoval se spole\u010dnostmi jako Zoopla, uSwitch, Mashable, Thomson Reuters a mnoha dal\u0161\u00edmi. Najm\u011bte si Lukasz Zelezny (MCIM, F IDM)","url":"https:\/\/seo.london\/cs\/author\/lukasz-zelezny\/"}]}},"_links":{"self":[{"href":"https:\/\/seo.london\/cs\/wp-json\/wp\/v2\/posts\/31157","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/seo.london\/cs\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/seo.london\/cs\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/seo.london\/cs\/wp-json\/wp\/v2\/users\/6"}],"replies":[{"embeddable":true,"href":"https:\/\/seo.london\/cs\/wp-json\/wp\/v2\/comments?post=31157"}],"version-history":[{"count":0,"href":"https:\/\/seo.london\/cs\/wp-json\/wp\/v2\/posts\/31157\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/seo.london\/cs\/wp-json\/wp\/v2\/media\/31181"}],"wp:attachment":[{"href":"https:\/\/seo.london\/cs\/wp-json\/wp\/v2\/media?parent=31157"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/seo.london\/cs\/wp-json\/wp\/v2\/categories?post=31157"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/seo.london\/cs\/wp-json\/wp\/v2\/tags?post=31157"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}