{"id":31157,"date":"2023-06-12T12:01:52","date_gmt":"2023-06-12T12:01:52","guid":{"rendered":"https:\/\/seo.london\/?p=31157"},"modified":"2023-06-29T16:47:23","modified_gmt":"2023-06-29T16:47:23","slug":"ka-bloket-robotus-ar-robots-txt","status":"publish","type":"post","link":"https:\/\/seo.london\/lv\/ka-bloket-robotus-ar-robots-txt\/","title":{"rendered":"K\u0101 blo\u0137\u0113t robotus ar Robots.txt?"},"content":{"rendered":"<p class=\"wp-block-paragraph\">Neinform\u0113tam nov\u0113rot\u0101jam robots, kas kl\u012bst pa j\u016bsu vietni, var \u0161\u0137ist k\u0101 no zin\u0101tnisk\u0101s fantastikas filmas. Ticiet vai n\u0113, tas ir t\u0101lu no fantastikas un tuv\u0101k realit\u0101tei, nek\u0101 j\u016bs dom\u0101jat! Ikvienam, kas p\u0101rvietojas pa t\u012bmek\u013ca viet\u0146u \u012bpa\u0161uma un uztur\u0113\u0161anas teritoriju, ir \u013coti svar\u012bgi saprast, k\u0101 roboti mijiedarbojas ar m\u016bsu tie\u0161saistes telp\u0101m. Tikpat b\u016btiska ir sp\u0113ja regul\u0113t \u0161o mijiedarb\u012bbu. \u0160\u012b nepiecie\u0161am\u012bba iepaz\u012bstina m\u016bs ar \u0113rtu r\u012bku: <a href=\"https:\/\/seo.london\/lv\/ka-izmantot-robots-txt-failu-seo\/\">roboti<\/a>.txt. \u0160aj\u0101 visaptvero\u0161aj\u0101 <a href=\"https:\/\/seo.london\/lv\/macities-seo\/\">ce\u013cvedis<\/a>, m\u0113s at\u0161ifr\u0113sim <a href=\"https:\/\/seo.london\/lv\/saites-veidosana-ka-ko-darit-donts\/\">ko<\/a> \"k\u0101 blo\u0137\u0113t bots robots txt\" noz\u012bm\u0113 un k\u0101p\u0113c tas ir svar\u012bgi m\u016bsdienu digit\u0101laj\u0101 laikmet\u0101.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"h-what-is-a-robots-txt-file\"><span class=\"ez-toc-section\" id=\"what-is-a-robotstxt-file\"><\/span>Kas ir Robots.txt fails?<span class=\"ez-toc-section-end\"><\/span><\/h2><div id=\"ez-toc-container\" class=\"ez-toc-v2_0_69_1 counter-hierarchy ez-toc-counter ez-toc-grey ez-toc-container-direction\">\n<div class=\"ez-toc-title-container\">\n<p class=\"ez-toc-title\" style=\"cursor:inherit\">Satura r\u0101d\u012bt\u0101js<\/p>\n<span class=\"ez-toc-title-toggle\"><a href=\"#\" class=\"ez-toc-pull-right ez-toc-btn ez-toc-btn-xs ez-toc-btn-default ez-toc-toggle\" aria-label=\"P\u0101rsl\u0113gt satura tabulu\"><span class=\"ez-toc-js-icon-con\"><span class=\"\"><span class=\"eztoc-hide\" style=\"display:none;\">P\u0101rsl\u0113gt<\/span><span class=\"ez-toc-icon-toggle-span\"><svg style=\"fill: #000000;color:#000000\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" class=\"list-377408\" width=\"20px\" height=\"20px\" viewbox=\"0 0 24 24\" fill=\"none\"><path d=\"M6 6H4v2h2V6zm14 0H8v2h12V6zM4 11h2v2H4v-2zm16 0H8v2h12v-2zM4 16h2v2H4v-2zm16 0H8v2h12v-2z\" fill=\"currentColor\"><\/path><\/svg><svg style=\"fill: #000000;color:#000000\" class=\"arrow-unsorted-368013\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"10px\" height=\"10px\" viewbox=\"0 0 24 24\" version=\"1.2\" baseprofile=\"tiny\"><path d=\"M18.2 9.3l-6.2-6.3-6.2 6.3c-.2.2-.3.4-.3.7s.1.5.3.7c.2.2.4.3.7.3h11c.3 0 .5-.1.7-.3.2-.2.3-.5.3-.7s-.1-.5-.3-.7zM5.8 14.7l6.2 6.3 6.2-6.3c.2-.2.3-.5.3-.7s-.1-.5-.3-.7c-.2-.2-.4-.3-.7-.3h-11c-.3 0-.5.1-.7.3-.2.2-.3.5-.3.7s.1.5.3.7z\"\/><\/svg><\/span><\/span><\/span><\/a><\/span><\/div>\n<nav><ul class='ez-toc-list ez-toc-list-level-1 eztoc-toggle-hide-by-default' ><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-1\" href=\"https:\/\/seo.london\/lv\/ka-bloket-robotus-ar-robots-txt\/#what-is-a-robotstxt-file\" title=\"Kas ir Robots.txt fails?\">Kas ir Robots.txt fails?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-2\" href=\"https:\/\/seo.london\/lv\/ka-bloket-robotus-ar-robots-txt\/#technical-robotstxt-syntax\" title=\"Tehnisk\u0101 Robots.txt sintakse\">Tehnisk\u0101 Robots.txt sintakse<\/a><ul class='ez-toc-list-level-3' ><li class='ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-3\" href=\"https:\/\/seo.london\/lv\/ka-bloket-robotus-ar-robots-txt\/#pattern-matching\" title=\"Pattern-Matching\">Pattern-Matching<\/a><\/li><\/ul><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-4\" href=\"https:\/\/seo.london\/lv\/ka-bloket-robotus-ar-robots-txt\/#checking-if-you-have-a-robotstxt-file\" title=\"P\u0101rbaude, vai ir izveidots robots.txt fails\">P\u0101rbaude, vai ir izveidots robots.txt fails<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-5\" href=\"https:\/\/seo.london\/lv\/ka-bloket-robotus-ar-robots-txt\/#how-to-create-a-robotstxt-file\" title=\"K\u0101 izveidot Robots.txt failu\">K\u0101 izveidot Robots.txt failu<\/a><ul class='ez-toc-list-level-3' ><li class='ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-6\" href=\"https:\/\/seo.london\/lv\/ka-bloket-robotus-ar-robots-txt\/#understanding-the-components-of-robotstxt\" title=\"Izpratne par Robots.txt sast\u0101vda\u013c\u0101m\">Izpratne par Robots.txt sast\u0101vda\u013c\u0101m<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-7\" href=\"https:\/\/seo.london\/lv\/ka-bloket-robotus-ar-robots-txt\/#fresh-file-generation\" title=\"Svaigu failu \u0123ener\u0113\u0161ana\">Svaigu failu \u0123ener\u0113\u0161ana<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-8\" href=\"https:\/\/seo.london\/lv\/ka-bloket-robotus-ar-robots-txt\/#uploading-your-file\" title=\"Faila aug\u0161upiel\u0101de\">Faila aug\u0161upiel\u0101de<\/a><\/li><\/ul><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-9\" href=\"https:\/\/seo.london\/lv\/ka-bloket-robotus-ar-robots-txt\/#blocking-specific-bots-and-filesfolders\" title=\"Konkr\u0113tu robotu un failu\/mapju blo\u0137\u0113\u0161ana\">Konkr\u0113tu robotu un failu\/mapju blo\u0137\u0113\u0161ana<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-10\" href=\"https:\/\/seo.london\/lv\/ka-bloket-robotus-ar-robots-txt\/#robotstxt-vs-meta-robots-vs-x-robots\" title=\"Robots.txt vs Meta Robots vs X-Robots\">Robots.txt vs Meta Robots vs X-Robots<\/a><ul class='ez-toc-list-level-3' ><li class='ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-11\" href=\"https:\/\/seo.london\/lv\/ka-bloket-robotus-ar-robots-txt\/#the-robotstxt-file\" title=\"Robots.txt fails\">Robots.txt fails<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-12\" href=\"https:\/\/seo.london\/lv\/ka-bloket-robotus-ar-robots-txt\/#what-are-meta-robots-tags\" title=\"Kas ir Meta robotu birkas?\">Kas ir Meta robotu birkas?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-13\" href=\"https:\/\/seo.london\/lv\/ka-bloket-robotus-ar-robots-txt\/#how-do-x-robots-tags-work\" title=\"K\u0101 darbojas X-Robots Tags?\">K\u0101 darbojas X-Robots Tags?<\/a><\/li><\/ul><\/li><\/ul><\/nav><\/div>\n\n\n\n\n<p class=\"wp-block-paragraph\">Robots.txt fails b\u016bt\u012bb\u0101 ir j\u016bsu vietnes sargs. Tas \u013cauj jums kontrol\u0113t <a href=\"https:\/\/seo.london\/lv\/eskorta-seo-pakalpojumi\/\">kas<\/a> j\u016bsu vietnes da\u013cas ir pieejamas robotu izp\u0113tei, piem\u0113ram, Google <a href=\"https:\/\/seo.london\/lv\/ka-veikt-paplasinato-meklesanu-pakalpojuma-google\/\">mekl\u0113t<\/a> dzin\u0113ju zirnek\u013ciem, un kur\u0101m j\u0101b\u016bt aizliegt\u0101m. Robotu izsl\u0113g\u0161anas standarta (neofici\u0101ls viet\u0146u izmantotais standarts) ietvaros tas sniedz nor\u0101d\u012bjumus t\u012bmek\u013ca robotiem par to at\u013cautaj\u0101m darb\u012bb\u0101m, kad tie apmekl\u0113 j\u016bsu vietni.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">\u0160is pietic\u012bgais teksta fails liecina par j\u016bsu lapas pieejam\u012bbas preferenc\u0113m. Vai jums ir \u012bpa\u0161i direktoriji vai lapas, kuras v\u0113laties pasarg\u0101t no zi\u0146k\u0101r\u012bgo robotu ac\u012bm? Robots.txt fail\u0101 j\u016bs varat to izdar\u012bt! T\u0101 satur\u0101 ir skaidri nor\u0101d\u012btas direkt\u012bvas - specifiski nor\u0101d\u012bjumi, kas tiek doti t\u012bmek\u013ca p\u0101rl\u016bkiem, lai efekt\u012bv\u0101k p\u0101rvald\u012btu vietnes pieejam\u012bbu. \u0160\u012b atjaut\u012bba \u013cauj nodro\u0161in\u0101t pareizu <a href=\"https:\/\/seo.london\/lv\/satura-marketinga-seo-pakalpojumi\/\">saturs<\/a> atvieglotu mekl\u0113\u0161anu, vienlaikus pasarg\u0101jot jut\u012bg\u0101s zonas no nejau\u0161as iedarb\u012bbas.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Galu gal\u0101, iem\u0101coties norobe\u017eot m\u016bsu kibervides da\u013cas <a href=\"https:\/\/seo.london\/lv\/ka-iegut-vairak-atsauces-domenu\/\">dom\u0113ni<\/a> prec\u012bzi \u013cauj mums k\u0101 t\u012bmek\u013ca p\u0101rzi\u0146iem lab\u0101k orient\u0113ties robotu kl\u0101tb\u016btn\u0113 un ietekm\u0113 m\u016bsu platformu v\u0113rt\u012bgaj\u0101s sf\u0113r\u0101s - t\u0101d\u0113\u013c m\u0113s \u0161odien koncentr\u0113jamies uz \u0161o jaut\u0101jumu.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"h-technical-robots-txt-syntax\"><span class=\"ez-toc-section\" id=\"technical-robotstxt-syntax\"><\/span>Tehnisk\u0101 Robots.txt sintakse<span class=\"ez-toc-section-end\"><\/span><\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">Robots.txt faila sintakse b\u016bt\u012bb\u0101 ir valodas un gramatikas. <a href=\"https:\/\/seo.london\/lv\/raksta-formats-un-raksta-struktura\/\">strukt\u016bra<\/a> izmanto, lai izveidotu t\u0101s direkt\u012bvas. Ir svar\u012bgi saprast, k\u0101 pareizi izmantot \u0161o sintaksi, lai pal\u012bdz\u0113tu apg\u016bt robots txt blo\u0137\u0113\u0161anas metodes.<\/p>\n\n\n\n<ol class=\"wp-block-list\" type=\"1\" start=\"1\">\n<li><strong>Lietot\u0101ja a\u0123ents:<\/strong> Lietot\u0101ja a\u0123enta direkt\u012bva nor\u0101da bota veidu, ar kuru v\u0113laties sazin\u0101ties, piem\u0113ram, Googlebot - Google vai BingBot - Google. <a href=\"https:\/\/seo.london\/lv\/timekla-vietne-nav-indekseta-bings-meklesana\/\">Bing<\/a>. S\u0101kot savu direkt\u012bvu komplektu ar \"User-agent: *\" noz\u012bm\u0113, ka visiem t\u012bmek\u013ca p\u0101rl\u016bkprogramm\u0101m ir j\u0101\u0146em v\u0113r\u0101 \u0161ie nor\u0101d\u012bjumi.<\/li>\n\n\n\n<li><strong>Aizliegt:<\/strong> \u0160\u012b direkt\u012bva s\u016bta vienk\u0101r\u0161u zi\u0146u - izvairieties no ce\u013ca, kas aprakst\u012bts uzreiz p\u0113c t\u0101s. Teiksim, ja j\u016bs uzrakst\u012btu: \"Aizliegt: \/images\/\", j\u016bs uzdodat jebkuram botam, kas to lasa, ne\u013caut <a href=\"https:\/\/seo.london\/lv\/jetoctopus\/\">p\u0101rmekl\u0113t<\/a> j\u016bsu vietnes <a href=\"https:\/\/seo.london\/lv\/google-neindekse-attelus\/\">att\u0113li<\/a> katalogs.<\/li>\n\n\n\n<li><strong>At\u013caut:<\/strong> Glu\u017ei pret\u0113ji aizliegumam \"aizliegtajos\" direktorijos ar pazi\u0146ojumu allow tiek atgriezta piek\u013cuves at\u013cauja noteiktiem apak\u0161direktorijiem vai failiem.<\/li>\n<\/ol>\n\n\n\n<h3 class=\"wp-block-heading\" id=\"h-pattern-matching\"><span class=\"ez-toc-section\" id=\"pattern-matching\"><\/span>Pattern-Matching<span class=\"ez-toc-section-end\"><\/span><\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">Sare\u017e\u0123\u012bts, bet sp\u0113c\u012bgs robots.txt faila sintakses elements ir rakstu sal\u012bdzin\u0101\u0161ana. L\u012bdztekus tie\u0161ai ce\u013cu nor\u0101d\u012b\u0161anai, rakstu saska\u0146o\u0161ana \u013cauj formul\u0113t sare\u017e\u0123\u012btus nor\u0101d\u012bjumus, k\u0101 blo\u0137\u0113t robotus robots txt fail\u0101, izmantojot vienk\u0101r\u0161us simbolus.<\/p>\n\n\n\n<ol class=\"wp-block-list\" type=\"1\" start=\"1\">\n<li>M\u0101coties par rakstz\u012bmju saska\u0146o\u0161anu, galvenok\u0101rt piev\u0113rsiet uzman\u012bbu div\u0101m b\u016btisk\u0101m rakstz\u012bm\u0113m - \"*\" (zvaigzn\u012bte) un \"$\" (dol\u0101ra z\u012bme). Zvaigzn\u012bte darbojas k\u0101 aizst\u0101j\u0113jz\u012bme, savuk\u0101rt dol\u0101ra z\u012bme simboliz\u0113 URL adres\u0101ta beigas.<\/li>\n\n\n\n<li>Izmantojot zvaigzn\u012bti aizlieguma pazi\u0146ojum\u0101, tiek apz\u012bm\u0113ta jebkura tur eso\u0161a virknes virknes sec\u012bba. Piem\u0113ram, \"Disallow: \/example\" aizliedz t\u012bmek\u013ca p\u0101rl\u016bkiem piek\u013c\u016bt jebkurai j\u016bsu vietnes lapai, kuras URL ir \"example\".<\/li>\n\n\n\n<li>Turpret\u012b pievienojot \"$\" j\u016bsu da\u017e\u0101do terminu beig\u0101s, tiek nor\u0101d\u012bts, ka tikai <a href=\"https:\/\/seo.london\/lv\/seo-draudzigi-urls\/\">URL adresi<\/a> kas beidzas \u0161\u0101di, ir aizliegts <a href=\"https:\/\/seo.london\/lv\/kada-ir-atskiriba-starp-parlukosanu-un-indeksesanu-seo-joma\/\">r\u0101po\u0161ana<\/a> ar botiem. Pazi\u0146ojums ar tekstu \"Aizliegt: \/*example$' ierobe\u017eo piek\u013cuvi tikai t\u0101m lap\u0101m, kuru URL beidzas tie\u0161i ar 'example'.<\/li>\n<\/ol>\n\n\n\n<p class=\"wp-block-paragraph\">Tom\u0113r atcerieties, ka ne visi zirnek\u013ci saprot vai iev\u0113ro \u0161os mode\u013cus, jo \u012bpa\u0161i daudzi uz surog\u0101tpastu orient\u0113ti zirnek\u013ci, t\u0101p\u0113c \u0146emiet to v\u0113r\u0101, veidojot direkt\u012bvas un mekl\u0113jot efekt\u012bvus veidus, k\u0101 efekt\u012bvi blo\u0137\u0113t robotus, izmantojot robots txt failus.\"\"\"\"\"\"<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Robots.txt faila izvieto\u0161ana var \u0161\u0137ist bied\u0113jo\u0161a, ta\u010du varat b\u016bt dro\u0161i, ka tas ir sal\u012bdzino\u0161i vienk\u0101r\u0161s process. \u0160is nelielais, bet \u013coti svar\u012bgais dokuments atrodas vien\u0101 prec\u012bz\u0101 viet\u0101 - j\u016bsu vietnes saknes direktorij\u0101.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Svar\u012bg\u0101kais ir atcer\u0113ties, ka \u0161im vienk\u0101r\u0161ajam teksta failam ir j\u0101b\u016bt viegli atrodamam r\u0101pu\u013cprogramm\u0101m. \"Saknes\" vai aug\u0161\u0113j\u0101 direktorija parasti ir vieta, kur mekl\u0113t\u0101jprogrammu roboti vispirms non\u0101k, kad <a href=\"https:\/\/seo.london\/lv\/vai-izkrausanas-lapas-ir-sliktas-seo\/\">nos\u0113\u0161an\u0101s<\/a> uz j\u016bsu <a href=\"https:\/\/seo.london\/lv\/precizas-atbilstibas-domena-plusi-un-minusi\/\">dom\u0113ns<\/a>. T\u0101d\u0113j\u0101di robots.txt faila ievieto\u0161ana \u0161eit sniedz t\u016bl\u012bt\u0113jus un skaidrus nor\u0101d\u012bjumus par to, kur\u0101m vietnes da\u013c\u0101m j\u0101b\u016bt pieejam\u0101m.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Tiem, kas maz\u0101k p\u0101rzina t\u012bmek\u013ca runu, iesp\u0113jams, rodas jaut\u0101jums, ko tie\u0161i m\u0113s dom\u0101jam, run\u0101jot par \"saknes\" direktoriju. B\u016bt\u012bb\u0101 j\u016bsu vietnes saknes direktorijs ir l\u012bdz\u012bgs koka stumbram, no kura atzarojas visi p\u0101r\u0113jie direktoriji - tas veido j\u016bsu tie\u0161saistes kl\u0101tb\u016btnes mugurkaulu. Piem\u0113ram, ja j\u016bsu vietnes URL ir www.example.com, tad saknes direktorijs ir \/ (sl\u012bpsv\u012btra aiz .com). T\u0101d\u0113j\u0101di www.example.com\/robots.txt prec\u012bzi nor\u0101da t\u0101s vietu j\u016bsu saknes direktorij\u0101.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Turpret\u012b, ievietojot to zem cita <a href=\"https:\/\/seo.london\/lv\/emuars-apaksdomena-vai-apaksdirektorija\/\">apak\u0161direktorijs<\/a> piem\u0113ram, \/blog\/robots.txt, neb\u016bs v\u0113lam\u0101 efekta, jo roboti necent\u012bsies mekl\u0113t j\u016bsu vietn\u0113 tik t\u0101lu, pirms ieg\u016bt nor\u0101d\u012bjumus.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">\u013boti svar\u012bgi, ka nepareiza pozicion\u0113\u0161ana var izrais\u012bt neefekt\u012bvu p\u0101rl\u016bko\u0161anu un indeks\u0113\u0161anu - divus b\u016btiskus faktorus, kas ietekm\u0113 <a href=\"https:\/\/seo.london\/lv\/\">SEO<\/a> pan\u0101kumus, jo mekl\u0113t\u0101jprogrammas nezin\u0101s, kur t\u0101m ir at\u013cauts vai aizliegts veikt izp\u0113ti, kad t\u0101s nekav\u0113joties non\u0101ks pie \"j\u016bsu durvju sliek\u0161\u0146a\".<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">T\u0101p\u0113c p\u0101rliecinieties, ka esat ieguvu\u0161i izvieto\u0161anu, kad skat\u0101ties, k\u0101 efekt\u012bvi blo\u0137\u0113t robotus, izmantojot robots txt failus. \u0160aj\u0101 tehniskaj\u0101 SEO st\u016brakmens iestat\u012bjum\u0101 izvietojumam patie\u0161\u0101m ir b\u016btiska noz\u012bme.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Izprotot robots.txt failu noz\u012bmi un darb\u012bbu, joproj\u0101m ir aktu\u0101ls jaut\u0101jums: k\u0101p\u0113c jums ir nepiecie\u0161ams robots.txt fails?<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Pirmk\u0101rt, robots.txt fails sniedz nor\u0101d\u012bjumus t\u012bmek\u013ca p\u0101rl\u016bkprogramm\u0101m par to, k\u0101 t\u0101m vajadz\u0113tu mijiedarboties ar j\u016bsu vietni. Kad mekl\u0113t\u0101jprogrammas v\u0113r\u0161as pie j\u016bsu vietnes, lai to indeks\u0113tu, \u0161ie robots.txt nor\u0101d\u012bjumi tiek \u0146emti v\u0113r\u0101. Tie sniedz nor\u0101d\u012bjumus mekl\u0113\u0161anas robotiem, piem\u0113ram, Google Googlebot vai Bing Bingbot, par to navig\u0101cijas ce\u013ciem pa j\u016bsu dom\u0113nu.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Otrk\u0101rt, robots.txt fails ir \u013coti svar\u012bgs, lai p\u0101rvald\u012btu piek\u013cuvi vietnes priv\u0101taj\u0101m sada\u013c\u0101m, kas ir sensit\u012bvas vai tiek izstr\u0101d\u0101tas. J\u016bs varat \u012bpa\u0161i uzdot robotiem no <a href=\"https:\/\/seo.london\/lv\/ka-panakt-lai-google-atrak-indekse-jusu-vietni\/\">indeks\u0113\u0161ana<\/a> \u0161\u0101du saturu. T\u0101d\u0113j\u0101di tiek nodro\u0161in\u0101ts, ka nev\u0113lam\u0101s jomas netiek indeks\u0113tas un nav publiski pieejamas mekl\u0113\u0161anas rezult\u0101tu lap\u0101s (SERP).<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Turkl\u0101t t\u012bmekl\u012b ir neskait\u0101mi roboti - gan labie, gan \u013caunpr\u0101t\u012bgie. Piel\u0101gojot to, kas un ko j\u016bsu vietn\u0113 var p\u0101rmekl\u0113t, izmantojot \u012bpa\u0161as \"User-agent\" komandas robots.txt fail\u0101, j\u016bs saglab\u0101jat augstus aizsardz\u012bbas standartus pret potenci\u0101liem draudiem, kas apmekl\u0113 j\u016bsu vietni nevain\u012bgas p\u0101rmekl\u0113\u0161anas aizseg\u0101.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Visbeidzot, bez Robots txt faila nodro\u0161in\u0101tajiem ierobe\u017eojumiem da\u017ei roboti var p\u0101rslogot serverus, p\u0101rslogojot tos ar piepras\u012bjumiem, k\u0101 rezult\u0101t\u0101 pal\u0113nin\u0101s lietot\u0101ju darb\u012bbas. <a href=\"https:\/\/seo.london\/lv\/kas-ir-lapas-pieredzes-signali\/\">pieredze<\/a> vai DDoS (Distributed Denial of Service) uzbrukumiem. T\u0101d\u0113j\u0101di tas darbojas k\u0101 svar\u012bgs r\u012bks, lai nodro\u0161in\u0101tu optim\u0101lu <a href=\"https:\/\/seo.london\/lv\/servera-puses-un-klienta-puses-renderesana\/\">serveris<\/a> <a href=\"https:\/\/seo.london\/lv\/zinasanu-baze\/how-to-monitor-seo-performance\/\">veiktsp\u0113ja<\/a>.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Kad v\u0113l\u0101k \u0161aj\u0101 rakst\u0101 s\u0101ksiet iepaz\u012bties ar sava Robots txt faila struktur\u0113\u0161anu, atcerieties \u0161o galveno j\u0113dzienu: Robots txt faila izveide ir \u013coti svar\u012bga, lai aizsarg\u0101tu un optimiz\u0113tu jebkura dom\u0113na kl\u0101tb\u016btni tie\u0161saist\u0113.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"h-checking-if-you-have-a-robots-txt-file\"><span class=\"ez-toc-section\" id=\"checking-if-you-have-a-robotstxt-file\"><\/span>P\u0101rbaude, vai ir izveidots robots.txt fails<span class=\"ez-toc-section-end\"><\/span><\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">Turpin\u0101sim par to, k\u0101 j\u016bs varat noskaidrot, vai j\u016bsu vietn\u0113 jau ir \"robots.txt\" fails. Parasti tas atrodas j\u016bsu vietnes saknes direktorij\u0101.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Lai p\u0101rbaud\u012btu, vai t\u0101 ir, es ieteiktu veikt \u0161\u0101dus vienk\u0101r\u0161us so\u013cus:<\/p>\n\n\n\n<ol class=\"wp-block-list\" type=\"1\" start=\"1\">\n<li>Atveriet savu iecien\u012bt\u0101ko t\u012bmek\u013ca p\u0101rl\u016bkprogrammu.<\/li>\n\n\n\n<li>In the <a href=\"https:\/\/seo.london\/lv\/vietejais-seo-bez-fiziskas-adreses\/\">adrese<\/a> b\u0101rs pie <a href=\"https:\/\/seo.london\/lv\/seo-agentura-londona\/\">top<\/a>, ierakstiet yoursitename.com\/robots.txt; aizst\u0101t \"yoursitename.com\" ar savu faktisko dom\u0113na nosaukumu.<\/li>\n<\/ol>\n\n\n\n<p class=\"wp-block-paragraph\">J\u016bsu ekr\u0101n\u0101 b\u016btu j\u0101par\u0101d\u0101s \u0161\u012b neuzkr\u012bto\u0161\u0101, bet ietekm\u012bg\u0101 faila robots.txt saturam, ja t\u0101ds ir j\u016bsu vietn\u0113. Savuk\u0101rt k\u013c\u016bdas zi\u0146ojums, kas l\u012bdzin\u0101s \"404 lapa nav atrasta\" vai \"fails nav atrasts\", nor\u0101da, ka robots.txt faila pa\u0161laik nav.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Atcerieties, ka pareizi \u012bstenojot \"k\u0101 blo\u0137\u0113t bots robots txt <a href=\"https:\/\/seo.london\/lv\/seo-strategija-londona\/\">strat\u0113\u0123ija<\/a> b\u016btiski ietekm\u0113 optimiz\u0101ciju mekl\u0113t\u0101jprogramm\u0101m (SEO). T\u0101p\u0113c ir \u013coti svar\u012bgi b\u016bt inform\u0113tam par to, vai jums t\u0101ds ir vai nav.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Rezum\u0113jot (lai gan tas nav oblig\u0101ti), robots.txt faila izpratne un pareiza izmanto\u0161ana ir neat\u0146emama veiksm\u012bgas t\u012bmek\u013ca viet\u0146u p\u0101rvald\u012bbas sast\u0101vda\u013ca m\u016bsdien\u0101s. Ja p\u0113c \u0161o darb\u012bbu veik\u0161anas joproj\u0101m neesat p\u0101rliecin\u0101ts par t\u0101 esam\u012bbas p\u0101rbaudi, apsveriet iesp\u0113ju sa\u0146emt eksperta padomu, jo tas var b\u016bt saist\u012bts ar sare\u017e\u0123\u012bt\u0101k\u0101m IT tehnolo\u0123ij\u0101m. <a href=\"https:\/\/seo.london\/lv\/ka-izmantot-google-zinasanu-grafiku\/\">zin\u0101\u0161anas<\/a> nek\u0101 gaid\u012bts.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Atcerieties ar\u012b, ka robots.txt neesam\u012bba nav oblig\u0101ti kait\u012bga - t\u0101 tikai noz\u012bm\u0113, ka mekl\u0113t\u0101jprogrammu robotiem ir neierobe\u017eota piek\u013cuve vis\u0101m j\u016bsu vietnes da\u013c\u0101m. B\u016btiska \u0161\u0101das piek\u013cuves kontrole k\u013c\u016bs piln\u012bgi iesp\u0113jama, kad saprat\u012bsim, k\u0101 efekt\u012bvi blo\u0137\u0113t bots robots txt sav\u0101s vietn\u0113s!<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"h-how-to-create-a-robots-txt-file\"><span class=\"ez-toc-section\" id=\"how-to-create-a-robotstxt-file\"><\/span>K\u0101 izveidot Robots.txt failu<span class=\"ez-toc-section-end\"><\/span><\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">Robots.txt faila izveide ir b\u016btisks solis, lai p\u0101rvald\u012btu, k\u0101 mekl\u0113t\u0101jprogrammu roboti mijiedarbojas ar j\u016bsu vietni. Iepaz\u012bsimies ar faila izveides procesu.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\" id=\"h-understanding-the-components-of-robots-txt\"><span class=\"ez-toc-section\" id=\"understanding-the-components-of-robotstxt\"><\/span>Izpratne par Robots.txt sast\u0101vda\u013c\u0101m<span class=\"ez-toc-section-end\"><\/span><\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">Tipisks robots.txt fails satur divas galven\u0101s sast\u0101vda\u013cas, tostarp User-agent un Disallow direkt\u012bvas. Lietot\u0101ja a\u0123ents attiecas uz konkr\u0113tu t\u012bmek\u013ca p\u0101rl\u016bku, piem\u0113ram, Googlebot vai Bingbot, kuram v\u0113laties, lai j\u016bsu nor\u0101d\u012bjumi b\u016btu adres\u0113ti. No otras puses, Disallow direkt\u012bv\u0101 ir uzskait\u012btas lapas vai direktoriji, kurus nev\u0113laties, lai da\u017ei roboti p\u0101rmekl\u0113tu. Piem\u0113ram:<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Lietot\u0101ja a\u0123ents: * Aizliegt: \/private\/<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">\u0160aj\u0101 gad\u012bjum\u0101 visiem botiem (\"*\" apz\u012bm\u0113 visus) tiek blo\u0137\u0113ta piek\u013cuve visam, kas atrodas direktorij\u0101 \"priv\u0101ts\".<\/p>\n\n\n\n<h3 class=\"wp-block-heading\" id=\"h-fresh-file-generation\"><span class=\"ez-toc-section\" id=\"fresh-file-generation\"><\/span>Svaigu failu \u0123ener\u0113\u0161ana<span class=\"ez-toc-section-end\"><\/span><\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">Tagad piev\u0113rs\u012bsimies \u0161\u012b atjaut\u012bg\u0101 koda \u0123ener\u0113\u0161anai. Jums b\u016bs nepiecie\u0161ams vienk\u0101r\u0161s teksta redaktors - Notepad ar to piln\u012bgi pietiks. T\u0101di teksta procesori k\u0101 Microsoft Word nav piem\u0113roti \u0161im uzdevumam, jo tie m\u0113dz ievietot papildu format\u0113\u0161anas rakstz\u012bmes.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Lai s\u0101ktu, izveidojiet jaunu dokumentu un saglab\u0101jiet to k\u0101 \"robots.txt\". Paturiet pr\u0101t\u0101, ka \u0161eit liela noz\u012bme ir lielajiem burtiem - p\u0101rliecinieties, ka viss rakst\u012bts ar mazajiem burtiem. P\u0113c tam izstr\u0101d\u0101jiet sintaksi atbilsto\u0161i sada\u013c\u0101m, kuras v\u0113laties blo\u0137\u0113t. Atcerieties, ka katram noteikumam j\u0101atrodas atsevi\u0161\u0137\u0101 rind\u0101:<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Lietot\u0101ja a\u0123ents: * Aizliegt: \/<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">\u0160is noteikums aizliedz visiem robotiem piek\u013c\u016bt jebkurai vietnes da\u013cai (apz\u012bm\u0113ta ar \"\/\"). Izmantojiet to piesardz\u012bgi!<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Port\u0101ls <a href=\"https:\/\/seo.london\/lv\/kas-ir-meta-atslegvardi\/\">atsl\u0113gv\u0101rds<\/a> \u0161eit ir specifiskums; m\u0101coties blo\u0137\u0113t robotus robots txt modu\u013ci ir daudzpus\u012bgi r\u012bki, kas \u013cauj prec\u012bzi kontrol\u0113t robotu darb\u012bbas.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\" id=\"h-uploading-your-file\"><span class=\"ez-toc-section\" id=\"uploading-your-file\"><\/span>Faila aug\u0161upiel\u0101de<span class=\"ez-toc-section-end\"><\/span><\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">Kad robots.txt fails ir izveidots, aug\u0161upiel\u0101d\u0113jiet to vietnes saknes map\u0113, izmantojot FTP (failu p\u0101rs\u016bt\u012b\u0161anas protokolu). Parasti tas atrodas taj\u0101 pa\u0161\u0101 viet\u0101, kur wp-admin, wp-content un wp-includes mape.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">P\u0113c \u0161o darb\u012bbu sekm\u012bgas veik\u0161anas lietot\u0101ji var atrast j\u016bsu Robots.txt failu, pievienojot \"\/robots.txt\" p\u0113c prim\u0101r\u0101 dom\u0113na, piem\u0113ram, www.example.com\/robots.txt. Tagad esat apguvis, k\u0101 izveidot robots.txt failu!<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Tom\u0113r atcerieties, ka, lai gan god\u012bgi r\u0101pot\u0101ji ir efekt\u012bvi, piekl\u0101j\u012bba dikt\u0113 tikai atbilst\u012bbu; vilt\u012bg\u0101ki destrukt\u012bvie roboti var izv\u0113l\u0113ties tos ignor\u0113t.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Tagad, kad \u0161\u012bs zin\u0101\u0161anas ir dro\u0161i iespraustas j\u016bsu jost\u0101, paturiet pr\u0101t\u0101, ka ir nepiecie\u0161ama apkope - periodiska uzraudz\u012bba nodro\u0161ina nep\u0101rtrauktu efektivit\u0101ti, t\u0101p\u0113c veltiet laiku regul\u0101r\u0101m p\u0101rbaud\u0113m. Priec\u012bgu kod\u0113\u0161anu!<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"h-blocking-specific-bots-and-files-folders\"><span class=\"ez-toc-section\" id=\"blocking-specific-bots-and-filesfolders\"><\/span>Konkr\u0113tu robotu un failu\/mapju blo\u0137\u0113\u0161ana<span class=\"ez-toc-section-end\"><\/span><\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">Izp\u0113tot t\u0113mu - k\u0101 blo\u0137\u0113t robotus robots txt, ir svar\u012bgi saprast, ka \u0161is uzdevums ne vienm\u0113r ir saist\u012bts ar visu p\u0101rl\u016bku ierobe\u017eo\u0161anu. Bie\u017ei vien j\u016bs var\u0113tu v\u0113l\u0113ties nor\u0101d\u012bt tikai da\u017eus nev\u0113lamus robotus vai ierobe\u017eot piek\u013cuvi tikai noteiktiem failiem un direktorijiem. \u0160ajos nians\u0113tajos scen\u0101rijos robots.txt faila apstr\u0101des prasmju uzlabo\u0161ana var b\u016bt \u013coti noz\u012bm\u012bga.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Vienot\u012bba daudzveid\u012bb\u0101 ir pla\u0161i izplat\u012bta taktika, ko izmanto da\u017e\u0101di tie\u0161saistes pakalpojumi. T\u012bmekl\u012b darbojas da\u017e\u0101di t\u012bmek\u013ca p\u0101rl\u016bkprogrammu veidi. <a href=\"https:\/\/seo.london\/lv\/seo-it-uznemumiem\/\">internets<\/a> ar at\u0161\u0137ir\u012bgu uzved\u012bbu un sp\u0113j\u0101m. Da\u017ei zirnek\u013ci ir \u013coti svar\u012bgi satura indeks\u0113\u0161anai, piem\u0113ram, Googlebot, bet citi, piem\u0113ram, surog\u0101tpasta roboti, var kait\u0113t j\u016bsu vietnes veiktsp\u0113jai.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">\u0160os maz\u0101k konstrukt\u012bvos robotus var blo\u0137\u0113t div\u0113j\u0101di: \u0161auri vai pla\u0161i. \u0160aur\u0101 pieeja noz\u012bm\u0113 blo\u0137\u0113t konkr\u0113tu robotu no visas vietnes, bet pla\u0161\u0101k\u0101 pieeja noz\u012bm\u0113 blo\u0137\u0113t katru robotu no konkr\u0113tas mapes vai faila.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Pirms turpin\u0101m, saprat\u012bsim, k\u0101 robots.txt fail\u0101 var nor\u0101d\u012bt lietot\u0101ja a\u0123entu (t. i., robotu). Katram noteikumam \u0161aj\u0101 dokument\u0101 j\u0101s\u0101kas, nor\u0101dot \"lietot\u0101ja a\u0123entu\", kam seko divst\u016bris(:), un p\u0113c tam j\u0101nor\u0101da a\u0123enta nosaukums. Atst\u0101jot to k\u0101 zvaigzn\u012bti (*), tas noz\u012bm\u0113, ka lapu apmekl\u0113 jebkur\u0161 robots. T\u0101 viet\u0101 var izv\u0113l\u0113ties ierakst\u012bt konkr\u0113tus nosaukumus konkr\u0113tiem botiem.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">T\u0101l\u0101k ir nor\u0101des \"Aizliegt\" vai \"At\u013caut\", kas nosaka at\u013caut\u0101s darb\u012bbas noteiktiem lietot\u0101ju a\u0123entiem attiec\u012bb\u0101 uz konkr\u0113t\u0101m j\u016bsu vietnes jom\u0101m.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Atcerieties, ka svar\u012bgi ir ne tikai zin\u0101t, k\u0101 blo\u0137\u0113t robotus robots txt, bet ar\u012b k\u0101p\u0113c - koncentr\u0113joties gan uz resursu iz\u0161\u0137\u0113rd\u0113\u0161anas nov\u0113r\u0161anu, gan uz aizsardz\u012bbu pret \u013caunpr\u0101t\u012bg\u0101m darb\u012bb\u0101m no kompromit\u0113tiem a\u0123entiem.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Pabeidzot m\u016bsu diskusiju par blo\u0137\u0113\u0161anas specifiku, j\u0101atceras, ka, uzticoties \u0161o noteikumu iev\u0113ro\u0161anai, liela noz\u012bme ir uzticam\u012bbai - galven\u0101s mekl\u0113t\u0101jprogrammas parasti stingri iev\u0113ro \u0161os noteikumus; diem\u017e\u0113l maz\u0101k paz\u012bstami skr\u0101p\u0113\u0161anas roboti reti kad tos iev\u0113ro pareizi. Nepa\u013caujieties tikai uz robots.txt, ja cen\u0161aties nodro\u0161in\u0101t sensit\u012bvus datus!<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"h-robots-txt-vs-meta-robots-vs-x-robots\"><span class=\"ez-toc-section\" id=\"robotstxt-vs-meta-robots-vs-x-robots\"><\/span>Robots.txt vs Meta Robots vs X-Robots<span class=\"ez-toc-section-end\"><\/span><\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">Ir \u013coti svar\u012bgi zin\u0101t, k\u0101 blo\u0137\u0113t robotus ar robots txt, ta\u010du t\u0101 nav vien\u012bg\u0101 metode, k\u0101 kontrol\u0113t robotu darb\u012bbu j\u016bsu vietn\u0113. Ir ar\u012b <a href=\"https:\/\/seo.london\/lv\/meta-apraksts-title-tag-h1-kontaktinformacijas-lapa\/\">meta<\/a> robots un x-robots tagus, divus citus efekt\u012bvus l\u012bdzek\u013cus, lai tie\u0161saistes robotiem sniegtu nor\u0101d\u012bjumus par j\u016bsu vietni. Ja j\u016bs dom\u0101jat, kuru no t\u0101m izmantot vai ar ko katra no t\u0101m at\u0161\u0137iras no cit\u0101m, \u013caujiet man paskaidrot.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\" id=\"h-the-robots-txt-file\"><span class=\"ez-toc-section\" id=\"the-robotstxt-file\"><\/span>Robots.txt fails<span class=\"ez-toc-section-end\"><\/span><\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">K\u0101 jau esam run\u0101ju\u0161i, robots.txt fails ir galvenais t\u012bmek\u013ca p\u0101rzi\u0146a ce\u013cvedis, kas \u013cauj mekl\u0113t\u0101jprogramm\u0101m novirz\u012bt mekl\u0113t\u0101jprogrammas uz konkr\u0113t\u0101m vietnes da\u013c\u0101m vai prom no t\u0101m. \u0160is nelielais teksta fails atrodas saknes direktoriju l\u012bmen\u012b un parasti sniedz visp\u0101r\u012bgas nor\u0101des visiem lietot\u0101ja a\u0123entu robotiem, ja vien nav nor\u0101d\u012bti konkr\u0113ti nor\u0101d\u012bjumi.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">B\u016bt\u012bb\u0101 robots.txt fail\u0101 ir teikts, ka robotiem: \"\u0160\u012bs jomas ir aizliegt\u0101s.\" Tom\u0113r \u0146emiet v\u0113r\u0101, ka ne visi zirnek\u013ci iev\u0113ro \u0161os noteikumus.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\" id=\"h-what-are-meta-robots-tags\"><span class=\"ez-toc-section\" id=\"what-are-meta-robots-tags\"><\/span>Kas ir Meta robotu birkas?<span class=\"ez-toc-section-end\"><\/span><\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">Meta robotu birkas pied\u0101v\u0101 detaliz\u0113t\u0101ku kontroli sal\u012bdzin\u0101jum\u0101 ar <a href=\"https:\/\/seo.london\/lv\/globalais-seo\/\">pla\u0161s<\/a> robots.txt fail\u0101 sniegt\u0101s vadl\u012bnijas. \u0160ie HTML atrib\u016bti nor\u0101da mekl\u0113t\u0101jprogrammu robotiem indeks\u0113t atsevi\u0161\u0137as lapas, nevis veselus katalogus vai vietnes. Tie nor\u0101da mekl\u0113t\u0101jprogramm\u0101m, vai lapu indeks\u0113t (\"noindex\"), sekot t\u0101s sait\u0113m (\"nofollow\"), \"none\" (kas noz\u012bm\u0113, ka nav j\u0101indeks\u0113 un j\u0101indeks\u0113), \"n\u0113\" (kas noz\u012bm\u0113, ka nav j\u0101indeks\u0113 un <a href=\"https:\/\/seo.london\/lv\/vai-man-vajadzetu-izmantot-atributu-nofollow-ieksejam-saitem\/\">nofollow<\/a>) un citas komandas. Meta robotu birkas tie\u0161i sazin\u0101s ar mekl\u0113t\u0101jprogrammu r\u0101pu\u013cprogramm\u0101m lapu pa lapai, pied\u0101v\u0101jot patiesu daudzpus\u012bbu r\u0101pu\u013cprogrammu darb\u012bbas p\u0101rvald\u012bb\u0101.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\" id=\"h-how-do-x-robots-tags-work\"><span class=\"ez-toc-section\" id=\"how-do-x-robots-tags-work\"><\/span>K\u0101 darbojas X-Robots Tags?<span class=\"ez-toc-section-end\"><\/span><\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">X-Robots tagiem ir da\u017eas l\u012bdz\u012bbas ar meta robots tagiem, jo tie ar\u012b sniedz detaliz\u0113tus nor\u0101d\u012bjumus lapas l\u012bmen\u012b. Tom\u0113r at\u0161\u0137ir\u012bb\u0101 no saviem analogiem, kas par\u0101d\u0101s HTML dokumentos, x-robots tagi ir izvietoti HTML dokumentos. <a href=\"https:\/\/seo.london\/lv\/kas-ir-jaukts-saturs\/\">HTTP<\/a> galvenes.  \u0160\u012b izvietojuma d\u0113\u013c t\u0101s var darboties ar\u012b ar failiem, kas nav HTML, piem\u0113ram, PDF failiem vai att\u0113liem. Tom\u0113r, t\u0101pat k\u0101 meta robotu tagu gad\u012bjum\u0101, x-robot tagu darb\u012bbas ir da\u017e\u0101das, piem\u0113ram, \"noindex\", \"nofollow\" vai pat \"nosnippet\".<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">T\u0101tad, lai gan m\u0101c\u012b\u0161an\u0101s blo\u0137\u0113t robotus, izmantojot robots txt, ir patie\u0161\u0101m v\u0113rt\u012bgas zin\u0101\u0161anas jebkuram t\u012bmek\u013ca administratoram, izpratne par metarobotu un x-robotu stipraj\u0101m pus\u0113m un pielietojumu sniedz v\u0113l pla\u0161\u0101ku r\u012bku kl\u0101stu, kad veidojat vietnes attiec\u012bbas ar t\u012bmek\u013ca p\u0101rl\u016bkiem.<\/p>","protected":false},"excerpt":{"rendered":"<p>Neinform\u0113tam nov\u0113rot\u0101jam robots, kas kl\u012bst pa j\u016bsu vietni, var \u0161\u0137ist k\u0101 no zin\u0101tnisk\u0101s fantastikas filmas. Ticiet vai n\u0113, tas ir t\u0101lu no fantastikas un tuv\u0101k realit\u0101tei, nek\u0101 j\u016bs dom\u0101jat! Ikvienam, kas p\u0101rvietojas pa t\u012bmek\u013ca viet\u0146u \u012bpa\u0161uma un uztur\u0113\u0161anas teritoriju, ir \u013coti svar\u012bgi saprast, k\u0101 roboti mijiedarbojas ar m\u016bsu tie\u0161saistes telp\u0101m. [...]<\/p>","protected":false},"author":6,"featured_media":31181,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[14],"tags":[],"class_list":["post-31157","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-seo"],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO Premium plugin v20.9 (Yoast SEO v26.4) - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>How to Block Bots with Robots.txt? - SEO.London<\/title>\n<meta name=\"description\" content=\"A robots.txt file is essentially the gatekeeper of your website. It allows you to control which parts of your site are available for bot exploration\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/seo.london\/lv\/ka-bloket-robotus-ar-robots-txt\/\" \/>\n<meta property=\"og:locale\" content=\"lv_LV\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"How to Block Bots with Robots.txt?\" \/>\n<meta property=\"og:description\" content=\"For an uninformed observer, a robot wandering around your website might seem like something out of a sci-fi movie. Believe it or not, it&#039;s far from\" \/>\n<meta property=\"og:url\" content=\"https:\/\/seo.london\/lv\/ka-bloket-robotus-ar-robots-txt\/\" \/>\n<meta property=\"og:site_name\" content=\"SEO.London\" \/>\n<meta property=\"article:published_time\" content=\"2023-06-12T12:01:52+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2023-06-29T16:47:23+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/seo.london\/wp-content\/uploads\/2023\/06\/How-to-Block-Bots-with-Robots.png\" \/>\n\t<meta property=\"og:image:width\" content=\"800\" \/>\n\t<meta property=\"og:image:height\" content=\"449\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"author\" content=\"Lukasz Zelezny\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Lukasz Zelezny\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"11 min\u016b\u0161u\" \/>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"K\u0101 blo\u0137\u0113t robotus ar Robots.txt? - SEO.London","description":"Robots.txt fails b\u016bt\u012bb\u0101 ir j\u016bsu vietnes sargs. Tas \u013cauj jums kontrol\u0113t, kuras vietnes da\u013cas ir pieejamas robotu izp\u0113tei.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/seo.london\/lv\/ka-bloket-robotus-ar-robots-txt\/","og_locale":"lv_LV","og_type":"article","og_title":"How to Block Bots with Robots.txt?","og_description":"For an uninformed observer, a robot wandering around your website might seem like something out of a sci-fi movie. Believe it or not, it's far from","og_url":"https:\/\/seo.london\/lv\/ka-bloket-robotus-ar-robots-txt\/","og_site_name":"SEO.London","article_published_time":"2023-06-12T12:01:52+00:00","article_modified_time":"2023-06-29T16:47:23+00:00","og_image":[{"width":800,"height":449,"url":"https:\/\/seo.london\/wp-content\/uploads\/2023\/06\/How-to-Block-Bots-with-Robots.png","type":"image\/png"}],"author":"Lukasz Zelezny","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Lukasz Zelezny","Est. reading time":"11 min\u016b\u0161u"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/seo.london\/fi\/how-to-block-bots-with-robots-txt\/","url":"https:\/\/seo.london\/how-to-block-bots-with-robots-txt\/","name":"K\u0101 blo\u0137\u0113t robotus ar Robots.txt? - SEO.London","isPartOf":{"@id":"https:\/\/seo.london\/fi\/#website"},"primaryImageOfPage":{"@id":"https:\/\/seo.london\/how-to-block-bots-with-robots-txt\/#primaryimage"},"image":{"@id":"https:\/\/seo.london\/how-to-block-bots-with-robots-txt\/#primaryimage"},"thumbnailUrl":"https:\/\/seo.london\/wp-content\/uploads\/2023\/06\/How-to-Block-Bots-with-Robots.png","datePublished":"2023-06-12T12:01:52+00:00","dateModified":"2023-06-29T16:47:23+00:00","author":{"@id":"https:\/\/seo.london\/fi\/#\/schema\/person\/a87f13cbf62c630a697ac094314f9e25"},"description":"Robots.txt fails b\u016bt\u012bb\u0101 ir j\u016bsu vietnes sargs. Tas \u013cauj jums kontrol\u0113t, kuras vietnes da\u013cas ir pieejamas robotu izp\u0113tei.","breadcrumb":{"@id":"https:\/\/seo.london\/how-to-block-bots-with-robots-txt\/#breadcrumb"},"inLanguage":"lv-LV","potentialAction":[{"@type":"ReadAction","target":["https:\/\/seo.london\/how-to-block-bots-with-robots-txt\/"]}]},{"@type":"ImageObject","inLanguage":"lv-LV","@id":"https:\/\/seo.london\/how-to-block-bots-with-robots-txt\/#primaryimage","url":"https:\/\/seo.london\/wp-content\/uploads\/2023\/06\/How-to-Block-Bots-with-Robots.png","contentUrl":"https:\/\/seo.london\/wp-content\/uploads\/2023\/06\/How-to-Block-Bots-with-Robots.png","width":800,"height":449,"caption":"How to Block Bots with Robots.txt"},{"@type":"BreadcrumbList","@id":"https:\/\/seo.london\/how-to-block-bots-with-robots-txt\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/seo.london\/fr\/"},{"@type":"ListItem","position":2,"name":"How to Block Bots with Robots.txt?"}]},{"@type":"WebSite","@id":"https:\/\/seo.london\/fi\/#website","url":"https:\/\/seo.london\/fi\/","name":"SEO.London","description":"SEO konsultantu un ekspertu uz\u0146\u0113mums London\u0101, Lielbrit\u0101nij\u0101 - Lukasz Zelezny","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/seo.london\/fi\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"lv-LV"},{"@type":"Person","@id":"https:\/\/seo.london\/fi\/#\/schema\/person\/a87f13cbf62c630a697ac094314f9e25","name":"Lukasz Zelezny","image":{"@type":"ImageObject","inLanguage":"lv-LV","@id":"https:\/\/seo.london\/fi\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/55d18e132c3d0d63f7cd047da2d2a7f805a3392a84a615be5d6dca867281758e?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/55d18e132c3d0d63f7cd047da2d2a7f805a3392a84a615be5d6dca867281758e?s=96&d=mm&r=g","caption":"Lukasz Zelezny"},"description":"#1 SEO konsultants, kas dz\u012bvo London\u0101 un str\u0101d\u0101jis ar t\u0101diem uz\u0146\u0113mumiem k\u0101 Zoopla, uSwitch, Mashable, Thomson Reuters un daudziem citiem. Lukasz Zelezny (MCIM, F IDM)","url":"https:\/\/seo.london\/lv\/author\/lukasz-zelezny\/"}]}},"_links":{"self":[{"href":"https:\/\/seo.london\/lv\/wp-json\/wp\/v2\/posts\/31157","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/seo.london\/lv\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/seo.london\/lv\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/seo.london\/lv\/wp-json\/wp\/v2\/users\/6"}],"replies":[{"embeddable":true,"href":"https:\/\/seo.london\/lv\/wp-json\/wp\/v2\/comments?post=31157"}],"version-history":[{"count":0,"href":"https:\/\/seo.london\/lv\/wp-json\/wp\/v2\/posts\/31157\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/seo.london\/lv\/wp-json\/wp\/v2\/media\/31181"}],"wp:attachment":[{"href":"https:\/\/seo.london\/lv\/wp-json\/wp\/v2\/media?parent=31157"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/seo.london\/lv\/wp-json\/wp\/v2\/categories?post=31157"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/seo.london\/lv\/wp-json\/wp\/v2\/tags?post=31157"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}