{"id":31157,"date":"2023-06-12T12:01:52","date_gmt":"2023-06-12T12:01:52","guid":{"rendered":"https:\/\/seo.london\/?p=31157"},"modified":"2023-06-29T16:47:23","modified_gmt":"2023-06-29T16:47:23","slug":"cum-sa-blocati-robotii-cu-robots-txt","status":"publish","type":"post","link":"https:\/\/seo.london\/ro\/cum-sa-blocati-robotii-cu-robots-txt\/","title":{"rendered":"Cum se blocheaz\u0103 bo\u021bii cu Robots.txt?"},"content":{"rendered":"<p class=\"wp-block-paragraph\">Pentru un observator neinformat, un robot care se plimb\u0103 pe site-ul dvs. web ar putea p\u0103rea ceva desprins dintr-un film SF. Crede\u021bi sau nu, este departe de fic\u021biune \u0219i mai aproape de realitate dec\u00e2t a\u021bi putea crede! Pentru oricine navigheaz\u0103 pe terenul de\u021binerii \u0219i \u00eentre\u021binerii site-urilor web, \u00een\u021belegerea modului \u00een care robo\u021bii interac\u021bioneaz\u0103 cu spa\u021biile noastre online este crucial\u0103. La fel de esen\u021bial este s\u0103 ave\u021bi capacitatea de a reglementa aceast\u0103 interac\u021biune. Aceast\u0103 necesitate ne prezint\u0103 un instrument la \u00eendem\u00e2n\u0103: <a href=\"https:\/\/seo.london\/ro\/cum-sa-utilizati-fisierul-robots-txt-in-seo\/\">robo\u021bi<\/a>.txt. \u00cen aceast\u0103 versiune cuprinz\u0103toare <a href=\"https:\/\/seo.london\/ro\/invatati-seo\/\">ghid<\/a>, vom decoda <a href=\"https:\/\/seo.london\/ro\/link-building-cum-ce-face-donts\/\">ce<\/a> \"cum s\u0103 blochezi bots robots txt\" \u00eenseamn\u0103 \u0219i de ce este important \u00een era digital\u0103 de ast\u0103zi.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"h-what-is-a-robots-txt-file\"><span class=\"ez-toc-section\" id=\"what-is-a-robotstxt-file\"><\/span>Ce este un fi\u0219ier Robots.txt?<span class=\"ez-toc-section-end\"><\/span><\/h2><div id=\"ez-toc-container\" class=\"ez-toc-v2_0_69_1 counter-hierarchy ez-toc-counter ez-toc-grey ez-toc-container-direction\">\n<div class=\"ez-toc-title-container\">\n<p class=\"ez-toc-title\" style=\"cursor:inherit\">Cuprins<\/p>\n<span class=\"ez-toc-title-toggle\"><a href=\"#\" class=\"ez-toc-pull-right ez-toc-btn ez-toc-btn-xs ez-toc-btn-default ez-toc-toggle\" aria-label=\"Comuta\u021bi tabelul de con\u021binut\"><span class=\"ez-toc-js-icon-con\"><span class=\"\"><span class=\"eztoc-hide\" style=\"display:none;\">Toggle<\/span><span class=\"ez-toc-icon-toggle-span\"><svg style=\"fill: #000000;color:#000000\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" class=\"list-377408\" width=\"20px\" height=\"20px\" viewbox=\"0 0 24 24\" fill=\"none\"><path d=\"M6 6H4v2h2V6zm14 0H8v2h12V6zM4 11h2v2H4v-2zm16 0H8v2h12v-2zM4 16h2v2H4v-2zm16 0H8v2h12v-2z\" fill=\"currentColor\"><\/path><\/svg><svg style=\"fill: #000000;color:#000000\" class=\"arrow-unsorted-368013\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"10px\" height=\"10px\" viewbox=\"0 0 24 24\" version=\"1.2\" baseprofile=\"tiny\"><path d=\"M18.2 9.3l-6.2-6.3-6.2 6.3c-.2.2-.3.4-.3.7s.1.5.3.7c.2.2.4.3.7.3h11c.3 0 .5-.1.7-.3.2-.2.3-.5.3-.7s-.1-.5-.3-.7zM5.8 14.7l6.2 6.3 6.2-6.3c.2-.2.3-.5.3-.7s-.1-.5-.3-.7c-.2-.2-.4-.3-.7-.3h-11c-.3 0-.5.1-.7.3-.2.2-.3.5-.3.7s.1.5.3.7z\"\/><\/svg><\/span><\/span><\/span><\/a><\/span><\/div>\n<nav><ul class='ez-toc-list ez-toc-list-level-1 eztoc-toggle-hide-by-default' ><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-1\" href=\"https:\/\/seo.london\/ro\/cum-sa-blocati-robotii-cu-robots-txt\/#what-is-a-robotstxt-file\" title=\"Ce este un fi\u0219ier Robots.txt?\">Ce este un fi\u0219ier Robots.txt?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-2\" href=\"https:\/\/seo.london\/ro\/cum-sa-blocati-robotii-cu-robots-txt\/#technical-robotstxt-syntax\" title=\"Sintaxa tehnic\u0103 Robots.txt\">Sintaxa tehnic\u0103 Robots.txt<\/a><ul class='ez-toc-list-level-3' ><li class='ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-3\" href=\"https:\/\/seo.london\/ro\/cum-sa-blocati-robotii-cu-robots-txt\/#pattern-matching\" title=\"Potrivire de modele\">Potrivire de modele<\/a><\/li><\/ul><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-4\" href=\"https:\/\/seo.london\/ro\/cum-sa-blocati-robotii-cu-robots-txt\/#checking-if-you-have-a-robotstxt-file\" title=\"Verificarea dac\u0103 ave\u021bi un fi\u0219ier robots.txt\">Verificarea dac\u0103 ave\u021bi un fi\u0219ier robots.txt<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-5\" href=\"https:\/\/seo.london\/ro\/cum-sa-blocati-robotii-cu-robots-txt\/#how-to-create-a-robotstxt-file\" title=\"Cum se creeaz\u0103 un fi\u0219ier Robots.txt\">Cum se creeaz\u0103 un fi\u0219ier Robots.txt<\/a><ul class='ez-toc-list-level-3' ><li class='ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-6\" href=\"https:\/\/seo.london\/ro\/cum-sa-blocati-robotii-cu-robots-txt\/#understanding-the-components-of-robotstxt\" title=\"\u00cen\u021belegerea componentelor din Robots.txt\">\u00cen\u021belegerea componentelor din Robots.txt<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-7\" href=\"https:\/\/seo.london\/ro\/cum-sa-blocati-robotii-cu-robots-txt\/#fresh-file-generation\" title=\"Genera\u021bia de fi\u0219iere proaspete\">Genera\u021bia de fi\u0219iere proaspete<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-8\" href=\"https:\/\/seo.london\/ro\/cum-sa-blocati-robotii-cu-robots-txt\/#uploading-your-file\" title=\"\u00cenc\u0103rcarea fi\u0219ierului dvs.\">\u00cenc\u0103rcarea fi\u0219ierului dvs.<\/a><\/li><\/ul><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-9\" href=\"https:\/\/seo.london\/ro\/cum-sa-blocati-robotii-cu-robots-txt\/#blocking-specific-bots-and-filesfolders\" title=\"Blocarea anumitor bo\u021bi \u0219i fi\u0219iere\/foldere\">Blocarea anumitor bo\u021bi \u0219i fi\u0219iere\/foldere<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-10\" href=\"https:\/\/seo.london\/ro\/cum-sa-blocati-robotii-cu-robots-txt\/#robotstxt-vs-meta-robots-vs-x-robots\" title=\"Robots.txt vs Meta Robots vs X-Robots\">Robots.txt vs Meta Robots vs X-Robots<\/a><ul class='ez-toc-list-level-3' ><li class='ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-11\" href=\"https:\/\/seo.london\/ro\/cum-sa-blocati-robotii-cu-robots-txt\/#the-robotstxt-file\" title=\"Fi\u0219ierul Robots.txt\">Fi\u0219ierul Robots.txt<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-12\" href=\"https:\/\/seo.london\/ro\/cum-sa-blocati-robotii-cu-robots-txt\/#what-are-meta-robots-tags\" title=\"Ce sunt Meta Robots Tags?\">Ce sunt Meta Robots Tags?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-13\" href=\"https:\/\/seo.london\/ro\/cum-sa-blocati-robotii-cu-robots-txt\/#how-do-x-robots-tags-work\" title=\"Cum func\u021bioneaz\u0103 etichetele X-Robots?\">Cum func\u021bioneaz\u0103 etichetele X-Robots?<\/a><\/li><\/ul><\/li><\/ul><\/nav><\/div>\n\n\n\n\n<p class=\"wp-block-paragraph\">Un fi\u0219ier robots.txt este, \u00een esen\u021b\u0103, gardianul site-ului dumneavoastr\u0103. Acesta v\u0103 permite s\u0103 controla\u021bi <a href=\"https:\/\/seo.london\/ro\/escorta-seo-serviciu\/\">care<\/a> p\u0103r\u021bi ale site-ului dvs. sunt disponibile pentru explorarea robotului - cum ar fi Google's <a href=\"https:\/\/seo.london\/ro\/cum-sa-efectuati-o-cautare-avansata-in-google\/\">c\u0103utare<\/a> \u0219i care ar trebui s\u0103 fie \u00een afara limitelor. Func\u021bion\u00e2nd ca parte a Standardului de excludere a robo\u021bilor (un standard neoficial utilizat de site-uri), acesta d\u0103 instruc\u021biuni robo\u021bilor web cu privire la ac\u021biunile permise atunci c\u00e2nd v\u0103 viziteaz\u0103 site-ul web.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Acest modest fi\u0219ier text spune multe despre preferin\u021bele dumneavoastr\u0103 \u00een materie de accesibilitate a paginilor. Ave\u021bi anumite directoare sau pagini pe care dori\u021bi s\u0103 le \u021bine\u021bi departe de ochii curio\u0219i ai robo\u021bilor? Fi\u0219ierul robots.txt v\u0103 acoper\u0103! Con\u021binutul s\u0103u stipuleaz\u0103 \u00een mod simplu directivele - instruc\u021biuni specifice date crawlerelor web - care contribuie la gestionarea mai eficient\u0103 a accesului la site. Aceast\u0103 ingeniozitate face ca asigurarea unei prezent\u0103ri corecte a <a href=\"https:\/\/seo.london\/ro\/marketing-de-continut-servicii-seo\/\">con\u021binut<\/a> la c\u0103ut\u0103ri mai u\u0219or, protej\u00e2nd \u00een acela\u0219i timp zonele sensibile de expunerea accidental\u0103.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">\u00cen cele din urm\u0103, \u00eenv\u0103\u021b\u00e2nd cum s\u0103 izol\u0103m por\u021biuni din spa\u021biul nostru cibernetic <a href=\"https:\/\/seo.london\/ro\/cum-sa-obtineti-mai-multe-domenii-de-referinta\/\">domenii<\/a> ne permite, \u00een calitate de webmasteri, s\u0103 navig\u0103m mai bine prezen\u021ba \u0219i influen\u021ba bot-ului \u00een cadrul domeniilor pre\u021bioase ale platformelor noastre - de aici \u0219i aten\u021bia noastr\u0103 de ast\u0103zi.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"h-technical-robots-txt-syntax\"><span class=\"ez-toc-section\" id=\"technical-robotstxt-syntax\"><\/span>Sintaxa tehnic\u0103 Robots.txt<span class=\"ez-toc-section-end\"><\/span><\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">Sintaxa unui fi\u0219ier robots.txt este \u00een esen\u021b\u0103 limbajul \u0219i gramatica <a href=\"https:\/\/seo.london\/ro\/formatul-articolului-si-structura-articolului\/\">structura<\/a> utilizat\u0103 pentru a crea directivele sale. Este esen\u021bial s\u0103 \u00een\u021belege\u021bi cum utilizarea corect\u0103 a acestei sintaxe v\u0103 poate ajuta s\u0103 \u00eenv\u0103\u021ba\u021bi cum s\u0103 bloca\u021bi robo\u021bii utiliz\u00e2nd robots txt.<\/p>\n\n\n\n<ol class=\"wp-block-list\" type=\"1\" start=\"1\">\n<li><strong>Agent utilizator:<\/strong> Directiva user-agent semnific\u0103 tipul de robot cu care dori\u021bi s\u0103 comunica\u021bi, cum ar fi Googlebot pentru Google sau BingBot pentru <a href=\"https:\/\/seo.london\/ro\/site-ul-web-nu-este-indexat-in-cautare-bings\/\">Bing<\/a>. \u00cencepe\u021bi setul de directive cu \"User-agent: *\" implic\u0103 faptul c\u0103 to\u021bi crawlerele web ar trebui s\u0103 \u021bin\u0103 cont de aceste instruc\u021biuni.<\/li>\n\n\n\n<li><strong>Nu permite:<\/strong> Aceast\u0103 directiv\u0103 transmite un mesaj simplu - evita\u021bi calea descris\u0103 imediat dup\u0103 ea. De exemplu, dac\u0103 scrie\u021bi \"Disallow: \/imagini\/\", \u00eei indica\u021bi oric\u0103rui robot care o cite\u0219te s\u0103 nu fac\u0103 urm\u0103toarele <a href=\"https:\/\/seo.london\/ro\/jetoctopus\/\">crawl<\/a> site-ul dvs. <a href=\"https:\/\/seo.london\/ro\/google-nu-indexeaza-imaginile\/\">imagini<\/a> director.<\/li>\n\n\n\n<li><strong>Permite\u021bi:<\/strong> La polul opus de disallow, \u00een cadrul directoarelor \"disallowed\", o instruc\u021biune allow acord\u0103 permisiunea de acces \u00eenapoi pentru anumite subdirectoare sau fi\u0219iere.<\/li>\n<\/ol>\n\n\n\n<h3 class=\"wp-block-heading\" id=\"h-pattern-matching\"><span class=\"ez-toc-section\" id=\"pattern-matching\"><\/span>Potrivire de modele<span class=\"ez-toc-section-end\"><\/span><\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">Un element complicat, dar puternic, al sintaxei fi\u0219ierului robots.txt este potrivirea modelelor. Pe l\u00e2ng\u0103 specificarea direct\u0103 a c\u0103ilor de acces, potrivirea de tipare v\u0103 permite s\u0103 articula\u021bi instruc\u021biuni complexe privind modul de blocare a robo\u021bilor \u00eentr-un fi\u0219ier robots txt prin intermediul unor simboluri simple.<\/p>\n\n\n\n<ol class=\"wp-block-list\" type=\"1\" start=\"1\">\n<li>Concentra\u021bi-v\u0103 \u00een primul r\u00e2nd asupra a dou\u0103 caractere esen\u021biale atunci c\u00e2nd \u00eenv\u0103\u021ba\u021bi despre potrivirea modelelor - \"*\" (asterisc) \u0219i \"$\" (semnul dolarului). Un asterisc ac\u021bioneaz\u0103 ca un wildcard, \u00een timp ce semnul dolarului simbolizeaz\u0103 sf\u00e2r\u0219itul unui URL.<\/li>\n\n\n\n<li>Folosirea unui asterisc \u00een interiorul unei declara\u021bii disallow denot\u0103 orice secven\u021b\u0103 de \u0219iruri de caractere prezent\u0103 acolo. De exemplu, \"Disallow: \/exemplu\" va interzice accesul crawlerelor web la orice pagin\u0103 de pe site-ul dvs. web al c\u0103rei URL con\u021bine \"exemplu\".<\/li>\n\n\n\n<li>Dimpotriv\u0103, dac\u0103 ad\u0103uga\u021bi \"$\" la sf\u00e2r\u0219itul termenilor diferi\u021bi, se specific\u0103 faptul c\u0103 numai <a href=\"https:\/\/seo.london\/ro\/urle-seo-prietenoase\/\">URL-uri<\/a> care se termin\u0103 astfel sunt interzise <a href=\"https:\/\/seo.london\/ro\/care-este-diferenta-dintre-crawling-si-indexare-in-seo\/\">t\u00e2r\u00e2re<\/a> de c\u0103tre robo\u021bi. O notificare care spune \"Disallow: \/*example$\" restric\u021bioneaz\u0103 accesul doar la paginile a c\u0103ror adres\u0103 URL se termin\u0103 exact cu \"example\".<\/li>\n<\/ol>\n\n\n\n<p class=\"wp-block-paragraph\">Nu uita\u021bi \u00eens\u0103 c\u0103 nu to\u021bi p\u0103ianjenii \u00een\u021beleg sau urmeaz\u0103 aceste modele - \u00een special mul\u021bi dintre cei orienta\u021bi spre spam - deci lua\u021bi \u00een considerare acest lucru \u00een timp ce construi\u021bi directive \u0219i discerne\u021bi modalit\u0103\u021bi eficiente de a bloca eficient robo\u021bii folosind fi\u0219iere robots txt.\"\"\"\"\"<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Navigarea prin plasarea fi\u0219ierului robots.txt poate p\u0103rea descurajant\u0103, dar fi\u021bi siguri c\u0103 este un proces relativ simplu. Acest document mic, dar esen\u021bial, trebuie s\u0103 se afle \u00eentr-o loca\u021bie precis\u0103 - directorul r\u0103d\u0103cin\u0103 al site-ului dvs. web.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Lucrul esen\u021bial de re\u021binut este c\u0103 acest simplu fi\u0219ier text trebuie s\u0103 fie u\u0219or de g\u0103sit de c\u0103tre crawlere. \"R\u0103d\u0103cina\" sau directorul cel mai de sus este, de obicei, cel \u00een care robo\u021bii motoarelor de c\u0103utare se duc mai \u00eent\u00e2i la <a href=\"https:\/\/seo.london\/ro\/paginile-de-destinatie-sunt-rele-pentru-seo\/\">aterizare<\/a> pe <a href=\"https:\/\/seo.london\/ro\/avantaje-si-dezavantaje-ale-domeniului-exact-match\/\">domeniu<\/a>. Prin urmare, plasarea fi\u0219ierului robots.txt aici ofer\u0103 instruc\u021biuni imediate \u0219i clare cu privire la p\u0103r\u021bile site-ului dvs. care ar trebui s\u0103 fie accesibile.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Acum, pentru cei mai pu\u021bin familiariza\u021bi cu limbajul web, s-ar putea s\u0103 v\u0103 \u00eentreba\u021bi la ce anume ne referim c\u00e2nd vorbim despre directorul \"root\". \u00cen esen\u021b\u0103, directorul r\u0103d\u0103cin\u0103 al site-ului dvs. web este asem\u0103n\u0103tor unui trunchi de copac din care se desprind toate celelalte directoare - acesta formeaz\u0103 coloana vertebral\u0103 a prezen\u021bei dvs. online. De exemplu, dac\u0103 URL-ul site-ului dvs. web este www.example.com, atunci r\u0103d\u0103cina ar fi \/ (bara oblic\u0103 dup\u0103 .com). Astfel, www.example.com\/robots.txt desemneaz\u0103 perfect locul s\u0103u \u00een cadrul directorului dvs. r\u0103d\u0103cin\u0103.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">\u00cen schimb, plasarea acestuia sub un alt <a href=\"https:\/\/seo.london\/ro\/blog-pe-subdomeniu-sau-subdirectoriu\/\">subdirectorul<\/a> cum ar fi \/blog\/robots.txt nu va avea efectul dorit, deoarece robo\u021bii nu se vor deranja s\u0103 caute at\u00e2t de departe \u00een site-ul dvs. \u00eenainte de a ob\u021bine instruc\u021biuni.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">\u00cen mod crucial, pozi\u021bionarea incorect\u0103 ar putea duce la un crawling \u0219i o indexare ineficient\u0103 - doi factori fundamentali \u00een <a href=\"https:\/\/seo.london\/ro\/\">SEO<\/a> succes - pentru c\u0103 motoarele de c\u0103utare nu vor \u0219ti unde le este permis sau interzis s\u0103 exploreze cu promptitudine atunci c\u00e2nd ajung la \"u\u0219a dumneavoastr\u0103\".<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">A\u0219adar, asigura\u021bi-v\u0103 c\u0103 a\u021bi reu\u0219it s\u0103 v\u0103 asigura\u021bi c\u0103 ave\u021bi un plasament bine pus la punct atunci c\u00e2nd analiza\u021bi cum s\u0103 bloca\u021bi eficient robo\u021bii folosind fi\u0219ierele robots txt. Plasarea joac\u0103 cu adev\u0103rat un rol integral \u00een cadrul acestui cadru tehnic de piatr\u0103 de temelie SEO.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">\u00cen\u021beleg\u00e2nd importan\u021ba \u0219i func\u021bionarea fi\u0219ierelor robots.txt, r\u0103m\u00e2ne o \u00eentrebare pertinent\u0103: de ce ave\u021bi nevoie de un fi\u0219ier robots.txt?<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">\u00cen primul r\u00e2nd, existen\u021ba unui fi\u0219ier robots.txt ofer\u0103 \u00eendrum\u0103ri crawlerelor web cu privire la modul \u00een care acestea ar trebui s\u0103 interac\u021bioneze cu site-ul dvs. web. Atunci c\u00e2nd motoarele de c\u0103utare se apropie de site-ul dvs. pentru a-l indexa, aceste instruc\u021biuni din fi\u0219ierul robots.txt intr\u0103 \u00een joc. Ele ghideaz\u0103 robo\u021bii de c\u0103utare, cum ar fi Googlebot de la Google sau Bingbot de la Bing, pe traseele lor de navigare prin domeniul dvs.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">\u00cen al doilea r\u00e2nd, un fi\u0219ier robots.txt este esen\u021bial pentru a gestiona accesul la sec\u021biunile private ale site-ului dvs. care sunt sensibile sau \u00een curs de dezvoltare. Pute\u021bi instrui \u00een mod specific robo\u021bii de la <a href=\"https:\/\/seo.london\/ro\/cum-sa-faceti-google-sa-va-indexeze-site-ul-mai-rapid\/\">indexare<\/a> un astfel de con\u021binut. Astfel, se asigur\u0103 c\u0103 zonele nedorite r\u0103m\u00e2n neindexate \u0219i nu sunt vizibile pentru public prin intermediul paginilor de rezultate ale motoarelor de c\u0103utare (SERP).<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">\u00cen plus, exist\u0103 nenum\u0103ra\u021bi robo\u021bi de c\u0103utare pe internet, at\u00e2t buni, c\u00e2t \u0219i r\u0103u inten\u021biona\u021bi. Prin stabilirea cine poate s\u0103 navigheze pe site-ul dvs. prin intermediul unor comenzi specifice de tip \"User-agent\" din fi\u0219ierul robots.txt, men\u021bine\u021bi standardele de protec\u021bie ridicate \u00eempotriva unor poten\u021biale amenin\u021b\u0103ri care v\u0103 viziteaz\u0103 sub pretextul unei activit\u0103\u021bi nevinovate de navigare.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">\u00cen cele din urm\u0103, f\u0103r\u0103 restric\u021biile furnizate de un fi\u0219ier Robots txt, unii robo\u021bi pot supra\u00eenc\u0103rca serverele prin supra\u00eenc\u0103rcarea lor cu cereri, ceea ce duce la un utilizator \u00eencetinit. <a href=\"https:\/\/seo.london\/ro\/ce-sunt-semnalele-de-experienta-a-paginii\/\">experien\u021b\u0103<\/a> sau atacuri DDoS (Distributed Denial of Service). Prin urmare, acesta ac\u021bioneaz\u0103 ca un instrument important pentru asigurarea unui nivel optim de <a href=\"https:\/\/seo.london\/ro\/randare-server-side-vs-client-side\/\">server<\/a> <a href=\"https:\/\/seo.london\/ro\/baza-de-cunostinte\/cum-sa-monitorizezi-performantele-de-operare\/\">performan\u021b\u0103<\/a>.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Pe m\u0103sur\u0103 ce \u00eencepe\u021bi s\u0103 v\u0103 familiariza\u021bi cu structurarea propriului fi\u0219ier Robots txt mai t\u00e2rziu \u00een acest articol, re\u021bine\u021bi acest concept cheie: Exemplificarea controlului asupra interac\u021biunilor crawlerelor cu site-ul dvs. web define\u0219te motivul pentru care existen\u021ba unui fi\u0219ier Robots txt particularizat este crucial\u0103 pentru protejarea \u0219i optimizarea prezen\u021bei online a oric\u0103rui domeniu.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"h-checking-if-you-have-a-robots-txt-file\"><span class=\"ez-toc-section\" id=\"checking-if-you-have-a-robotstxt-file\"><\/span>Verificarea dac\u0103 ave\u021bi un fi\u0219ier robots.txt<span class=\"ez-toc-section-end\"><\/span><\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">S\u0103 trecem acum la modul \u00een care pute\u021bi verifica dac\u0103 site-ul dvs. are deja un fi\u0219ier \"robots.txt\". \u00cen general, acesta se afl\u0103 \u00een directorul r\u0103d\u0103cin\u0103 al site-ului dvs.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Pentru a verifica prezen\u021ba acestuia, v\u0103 recomand urm\u0103torii pa\u0219i simpli:<\/p>\n\n\n\n<ol class=\"wp-block-list\" type=\"1\" start=\"1\">\n<li>Deschide\u021bi browserul dvs. web preferat.<\/li>\n\n\n\n<li>\u00cen <a href=\"https:\/\/seo.london\/ro\/seo-local-fara-adresa-fizica\/\">adresa<\/a> bar la <a href=\"https:\/\/seo.london\/ro\/agentie-seo-londra\/\">top<\/a>, tasta\u021bi yoursitename.com\/robots.txt; \u00eenlocui\u021bi \"yoursitename.com\" cu numele real al domeniului dumneavoastr\u0103.<\/li>\n<\/ol>\n\n\n\n<p class=\"wp-block-paragraph\">Ecranul dvs. ar trebui s\u0103 afi\u0219eze con\u021binutul acestui fi\u0219ier \"robots.txt\" neasemuit, dar influent, dac\u0103 acesta exist\u0103 pe site-ul dvs. Dimpotriv\u0103, un mesaj de eroare asem\u0103n\u0103tor cu \"404 page not found\" sau \"file not found\" ar \u00eensemna c\u0103 nu exist\u0103 \u00een prezent niciun fi\u0219ier robots.txt.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Aminti\u021bi-v\u0103 c\u0103 implementarea corect\u0103 a unui \"cum s\u0103 blochezi robo\u021bii bots robots txt <a href=\"https:\/\/seo.london\/ro\/strategie-seo-londra\/\">strategie<\/a> are un impact semnificativ asupra optimiz\u0103rii pentru motoarele de c\u0103utare (SEO). Prin urmare, este esen\u021bial s\u0103 r\u0103m\u00e2ne\u021bi informat dac\u0103 ave\u021bi sau nu unul.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Pe scurt (de\u0219i nu este obligatoriu), \u00een\u021belegerea \u0219i utilizarea corect\u0103 a fi\u0219ierului \"robots.txt\" face parte integrant\u0103 din gestionarea site-urilor web de succes \u00een prezent. Dac\u0103 sunte\u021bi \u00eenc\u0103 nesigur dup\u0103 ce a\u021bi efectuat ace\u0219ti pa\u0219i pentru verificarea existen\u021bei acestuia, lua\u021bi \u00een considerare posibilitatea de a cere sfatul unui expert, deoarece ar putea implica un nivel mai avansat de IT <a href=\"https:\/\/seo.london\/ro\/cum-folosesc-google-knowledge-graph\/\">cuno\u0219tin\u021be<\/a> dec\u00e2t se a\u0219tepta.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Re\u021bine\u021bi, de asemenea, c\u0103 faptul c\u0103 nu exist\u0103 niciun \"robots.txt\" nu este neap\u0103rat d\u0103un\u0103tor - \u00eenseamn\u0103 pur \u0219i simplu c\u0103 robo\u021bii motoarelor de c\u0103utare au acces nelimitat \u00een toate zonele site-ului dumneavoastr\u0103. Un control semnificativ asupra unui astfel de acces devine eminamente posibil odat\u0103 ce \u00een\u021belegem \"cum s\u0103 bloc\u0103m \u00een mod eficient bots robots txt\" pe site-urile noastre!<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"h-how-to-create-a-robots-txt-file\"><span class=\"ez-toc-section\" id=\"how-to-create-a-robotstxt-file\"><\/span>Cum se creeaz\u0103 un fi\u0219ier Robots.txt<span class=\"ez-toc-section-end\"><\/span><\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">Crearea unui fi\u0219ier robots.txt este un pas esen\u021bial \u00een gestionarea modului \u00een care robo\u021bii motoarelor de c\u0103utare interac\u021bioneaz\u0103 cu site-ul dvs. web. Haide\u021bi s\u0103 ne scufund\u0103m \u00een procesul de creare a unuia.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\" id=\"h-understanding-the-components-of-robots-txt\"><span class=\"ez-toc-section\" id=\"understanding-the-components-of-robotstxt\"><\/span>\u00cen\u021belegerea componentelor din Robots.txt<span class=\"ez-toc-section-end\"><\/span><\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">Un fi\u0219ier robots.txt tipic con\u021bine dou\u0103 componente principale, inclusiv directivele User-agent \u0219i Disallow. User-agent se refer\u0103 la un anumit robot de c\u0103utare web, cum ar fi Googlebot sau Bingbot, pe care dori\u021bi s\u0103 \u00eel direc\u021biona\u021bi. Pe de alt\u0103 parte, directiva Disallow este cea \u00een care lista\u021bi paginile sau directoarele pe care nu dori\u021bi ca anumi\u021bi robo\u021bi s\u0103 le acceseze. De exemplu:<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Agent utilizator: * Disallow: \/private\/<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">\u00cen acest caz, to\u021bi robo\u021bii (\"*\" \u00eenseamn\u0103 \"all\") sunt bloca\u021bi s\u0103 acceseze tot ce se afl\u0103 \u00een directorul \"private\".<\/p>\n\n\n\n<h3 class=\"wp-block-heading\" id=\"h-fresh-file-generation\"><span class=\"ez-toc-section\" id=\"fresh-file-generation\"><\/span>Genera\u021bia de fi\u0219iere proaspete<span class=\"ez-toc-section-end\"><\/span><\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">Acum, pentru a genera aceast\u0103 bucat\u0103 de cod. Ve\u021bi avea nevoie de un editor de text simplu - Notepad se va descurca foarte bine. Procesoarele de text, cum ar fi Microsoft Word, nu sunt potrivite pentru aceast\u0103 sarcin\u0103 din cauza tendin\u021bei lor de a insera caractere de formatare suplimentare.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Pentru a \u00eencepe, crea\u021bi un document nou \u0219i salva\u021bi-l ca \"robots.txt\". Re\u021bine\u021bi c\u0103 aici conteaz\u0103 majusculele - asigura\u021bi-v\u0103 c\u0103 totul este scris cu minuscule. Urmeaz\u0103 elaborarea sintaxei \u00een func\u021bie de sec\u021biunile pe care urm\u0103ri\u021bi s\u0103 le bloca\u021bi. Nu uita\u021bi, fiecare regul\u0103 trebuie s\u0103 fie pe propria linie:<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Agent utilizator: * Disallow: \/<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Aceast\u0103 regul\u0103 interzice tuturor robo\u021bilor s\u0103 acceseze orice parte a site-ului dvs. (semnificat\u0103 cu \"\/\"). Folosi\u021bi-o cu pruden\u021b\u0103!<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">The <a href=\"https:\/\/seo.london\/ro\/ce-sunt-meta-cuvinte-cheie\/\">cuv\u00e2nt cheie<\/a> aici este specificitatea; atunci c\u00e2nd \u00eenv\u0103\u021ba\u021bi cum s\u0103 bloca\u021bi robo\u021bii, modulele robots txt sunt instrumente versatile care permit un control precis asupra ac\u021biunilor robo\u021bilor.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\" id=\"h-uploading-your-file\"><span class=\"ez-toc-section\" id=\"uploading-your-file\"><\/span>\u00cenc\u0103rcarea fi\u0219ierului dvs.<span class=\"ez-toc-section-end\"><\/span><\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">Odat\u0103 creat, \u00eenc\u0103rca\u021bi fi\u0219ierul robots.txt \u00een folderul r\u0103d\u0103cin\u0103 al site-ului dvs. utiliz\u00e2nd FTP (File Transfer Protocol). De obicei, acesta se afl\u0103 \u00een aceea\u0219i loca\u021bie ca \u0219i folderul wp-admin, wp-content \u0219i wp-includes.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Dup\u0103 ce a\u021bi finalizat cu succes ace\u0219ti pa\u0219i, utilizatorii pot localiza fi\u0219ierul Robots.txt ad\u0103ug\u00e2nd \"\/robots.txt\" dup\u0103 domeniul dvs. principal - de exemplu, www.example.com\/robots.txt. Acum a\u021bi \u00eenv\u0103\u021bat cum s\u0103 crea\u021bi un fi\u0219ier robots.txt!<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Nu uita\u021bi totu\u0219i c\u0103, de\u0219i este eficient \u00een direc\u021bionarea crawlerelor oneste, curtoazia dicteaz\u0103 doar conformitatea; robo\u021bii mai vicleni \u0219i mai distructivi pot alege s\u0103 le ignore complet.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Cu aceste cuno\u0219tin\u021be acum bine ascunse, nu uita\u021bi c\u0103 este necesar\u0103 \u00eentre\u021binerea - monitorizarea periodic\u0103 asigur\u0103 o eficacitate continu\u0103, a\u0219a c\u0103 face\u021bi-v\u0103 timp pentru inspec\u021bii regulate. Codare pl\u0103cut\u0103!<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"h-blocking-specific-bots-and-files-folders\"><span class=\"ez-toc-section\" id=\"blocking-specific-bots-and-filesfolders\"><\/span>Blocarea anumitor bo\u021bi \u0219i fi\u0219iere\/foldere<span class=\"ez-toc-section-end\"><\/span><\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">Atunci c\u00e2nd aprofund\u0103m subiectul - cum s\u0103 bloc\u0103m bots robots txt, este important s\u0103 \u00een\u021belegem c\u0103 aceast\u0103 sarcin\u0103 nu \u00eenseamn\u0103 \u00eentotdeauna restric\u021bionarea tuturor crawlerelor. Deseori, s-ar putea s\u0103 dori\u021bi s\u0103 specifica\u021bi doar anumi\u021bi robo\u021bi nedori\u021bi sau s\u0103 restric\u021biona\u021bi accesul doar la anumite fi\u0219iere \u0219i directoare. \u00cen aceste scenarii nuan\u021bate, sporirea cuno\u0219tin\u021belor privind gestionarea fi\u0219ierului robots.txt ar putea face diferen\u021ba.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Unitatea \u00een diversitate este o tactic\u0103 foarte r\u0103sp\u00e2ndit\u0103, folosit\u0103 de diverse servicii online. Diferite tipuri de crawlere web plutesc \u00een jurul <a href=\"https:\/\/seo.london\/ro\/seo-pentru-companii-it\/\">internet<\/a> cu comportamente \u0219i capacit\u0103\u021bi diferite. \u00cen timp ce unii p\u0103ianjeni sunt esen\u021biali pentru indexarea con\u021binutului, cum ar fi Googlebot, al\u021bii, cum ar fi robo\u021bii de spam, ar putea afecta performan\u021ba site-ului dumneavoastr\u0103.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Ace\u0219ti robo\u021bi mai pu\u021bin constructivi pot fi bloca\u021bi \u00een dou\u0103 feluri: \u00een mod restr\u00e2ns sau larg. Abordarea restr\u00e2ns\u0103 \u00eenseamn\u0103 blocarea unui anumit robot de pe \u00eentregul site web, \u00een timp ce cea mai larg\u0103 presupune blocarea fiec\u0103rui robot de pe un anumit dosar sau fi\u0219ier.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">\u00cenainte de a continua, haide\u021bi s\u0103 \u00een\u021belegem cum pute\u021bi specifica un user-agent (adic\u0103 un robot) \u00een fi\u0219ierul robots.txt. Fiecare regul\u0103 din acest document trebuie s\u0103 \u00eenceap\u0103 prin specificarea \"User-agent\", urmat\u0103 de dou\u0103 puncte (:) \u0219i apoi prin delimitarea numelui agentului. L\u0103sarea acestuia sub forma unui asterisc (*) implic\u0103 orice robot care viziteaz\u0103 pagina. \u00cen schimb, se poate opta pentru a scrie anumite nume pentru anumi\u021bi robo\u021bi.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Urmeaz\u0103 directivele \"Disallow\" sau \"Allow\", care indic\u0103 ac\u021biunile permise pentru agen\u021bii-utilizatori identifica\u021bi \u00een anumite zone specifice ale site-ului dumneavoastr\u0103.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Nu uita\u021bi, importan\u021ba nu const\u0103 doar \u00een a \u0219ti cum s\u0103 bloca\u021bi bots robots txt, ci \u0219i de ce - concentr\u00e2ndu-se at\u00e2t pe prevenirea risipei de resurse, c\u00e2t \u0219i pe protejarea \u00eempotriva activit\u0103\u021bilor r\u0103u inten\u021bionate ale agen\u021bilor compromi\u0219i.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Pentru a completa discursul nostru privind specificul bloc\u0103rii, nu uita\u021bi c\u0103 fiabilitatea joac\u0103 un rol important atunci c\u00e2nd ave\u021bi \u00eencredere \u00een respectarea acestor reguli - motoarele de c\u0103utare principale respect\u0103, \u00een general, cu stricte\u021be; din nefericire, robo\u021bii de r\u0103zuire mai pu\u021bin cunoscu\u021bi rareori se conformeaz\u0103 \u00een mod corespunz\u0103tor. Nu v\u0103 baza\u021bi doar pe robots.txt dac\u0103 \u00eencerca\u021bi s\u0103 securiza\u021bi date sensibile!<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"h-robots-txt-vs-meta-robots-vs-x-robots\"><span class=\"ez-toc-section\" id=\"robotstxt-vs-meta-robots-vs-x-robots\"><\/span>Robots.txt vs Meta Robots vs X-Robots<span class=\"ez-toc-section-end\"><\/span><\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">Este esen\u021bial s\u0103 \u0219ti\u021bi cum s\u0103 bloca\u021bi robo\u021bii cu robots txt, dar nu este singura metod\u0103 de a controla comportamentul robo\u021bilor pe site-ul dvs. web. Exist\u0103, de asemenea, \u0219i <a href=\"https:\/\/seo.london\/ro\/meta-description-title-tag-h1-pe-pagina-de-contact\/\">meta<\/a> robots \u0219i x-robots, alte dou\u0103 mijloace eficiente de a oferi robo\u021bilor online instruc\u021biuni despre site-ul dumneavoastr\u0103. Dac\u0103 v\u0103 \u00eentreba\u021bi pe care dintre ele s\u0103 le folosi\u021bi sau ce le deosebe\u0219te pe fiecare dintre ele, permite\u021bi-mi s\u0103 v\u0103 explic.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\" id=\"h-the-robots-txt-file\"><span class=\"ez-toc-section\" id=\"the-robotstxt-file\"><\/span>Fi\u0219ierul Robots.txt<span class=\"ez-toc-section-end\"><\/span><\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">Dup\u0103 cum am discutat deja, un fi\u0219ier robots.txt ac\u021bioneaz\u0103 ca un ghid principal al webmasterului pentru a direc\u021biona motoarele de c\u0103utare c\u0103tre sau de la anumite p\u0103r\u021bi ale unui site web. Acest mic fi\u0219ier de text se afl\u0103 la nivelul directorului r\u0103d\u0103cin\u0103 \u0219i ofer\u0103, de obicei, directive generale pentru to\u021bi robo\u021bii user-agent, cu excep\u021bia cazului \u00een care sunt indicate unele specifice.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">\u00cen esen\u021b\u0103, fi\u0219ierul robots.txt le spune robo\u021bilor: \"Aceste zone sunt interzise.\" Cu toate acestea, fi\u021bi aten\u021bi la faptul c\u0103 nu to\u021bi spiderii vor respecta aceste reguli.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\" id=\"h-what-are-meta-robots-tags\"><span class=\"ez-toc-section\" id=\"what-are-meta-robots-tags\"><\/span>Ce sunt Meta Robots Tags?<span class=\"ez-toc-section-end\"><\/span><\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">Meta Robots Tags ofer\u0103 un control mai granular \u00een compara\u021bie cu <a href=\"https:\/\/seo.london\/ro\/seo-global\/\">larg<\/a> orient\u0103rile furnizate de un fi\u0219ier robots.txt. Aceste atribute HTML instruiesc robo\u021bii motoarelor de c\u0103utare cu privire la indexarea paginilor individuale, mai degrab\u0103 dec\u00e2t a unor directoare sau site-uri \u00eentregi. Acestea indic\u0103 motoarelor de c\u0103utare dac\u0103 trebuie s\u0103 indexeze o pagin\u0103 (\"noindex\"), s\u0103 urm\u0103reasc\u0103 leg\u0103turile sale (\"nofollow\"), \"none\" (care implic\u0103 noindex \u0219i <a href=\"https:\/\/seo.london\/ro\/ar-trebui-sa-folosesc-atributul-nofollow-pentru-legaturile-interne\/\">nofollow<\/a>), printre alte comenzi. Meta etichetele robot comunic\u0103 direct cu crawlerele motoarelor de c\u0103utare, pagin\u0103 cu pagin\u0103, oferind o adev\u0103rat\u0103 versatilitate \u00een gestionarea comportamentului crawlerelor.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\" id=\"h-how-do-x-robots-tags-work\"><span class=\"ez-toc-section\" id=\"how-do-x-robots-tags-work\"><\/span>Cum func\u021bioneaz\u0103 etichetele X-Robots?<span class=\"ez-toc-section-end\"><\/span><\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">Etichetele X-Robots au unele asem\u0103n\u0103ri cu meta-tagurile robots, deoarece ofer\u0103, de asemenea, instruc\u021biuni detaliate la nivelul paginii. Cu toate acestea, spre deosebire de omologii lor care apar \u00een cadrul documentelor HTML, etichetele x-robots se afl\u0103 \u00een <a href=\"https:\/\/seo.london\/ro\/ce-este-continutul-mixt\/\">HTTP<\/a> anteturi.  \u00cen special, aceast\u0103 plasare le permite s\u0103 func\u021bioneze chiar \u0219i pentru fi\u0219iere non-HTML, cum ar fi PDF-uri sau imagini. La fel ca \u0219i \u00een cazul tag-urilor meta robot, ac\u021biunile tag-urilor x-robot variaz\u0103 de la \"noindex\", \"nofollow\" sau chiar \"nosnippet\", printre altele.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">A\u0219adar, \u00een timp ce a \u00eenv\u0103\u021ba cum s\u0103 blochezi robo\u021bii folosind robots txt este \u00eentr-adev\u0103r o cuno\u0219tin\u021b\u0103 valoroas\u0103 pentru orice webmaster, \u00een\u021belegerea punctelor forte \u0219i a aplica\u021biilor meta-roboturilor \u0219i x-roboturilor ofer\u0103 un set de instrumente \u0219i mai larg atunci c\u00e2nd se gestioneaz\u0103 rela\u021bia site-ului dvs. cu crawlerele web.<\/p>","protected":false},"excerpt":{"rendered":"<p>Pentru un observator neinformat, un robot care se plimb\u0103 pe site-ul dvs. web ar putea p\u0103rea ceva desprins dintr-un film SF. Crede\u021bi sau nu, este departe de fic\u021biune \u0219i mai aproape de realitate dec\u00e2t a\u021bi putea crede! Pentru oricine navigheaz\u0103 pe terenul de\u021binerii \u0219i \u00eentre\u021binerii site-urilor web, \u00een\u021belegerea modului \u00een care robo\u021bii interac\u021bioneaz\u0103 cu spa\u021biile noastre online este crucial\u0103. [...]<\/p>","protected":false},"author":6,"featured_media":31181,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[14],"tags":[],"class_list":["post-31157","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-seo"],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO Premium plugin v20.9 (Yoast SEO v26.4) - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>How to Block Bots with Robots.txt? - SEO.London<\/title>\n<meta name=\"description\" content=\"A robots.txt file is essentially the gatekeeper of your website. It allows you to control which parts of your site are available for bot exploration\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/seo.london\/ro\/cum-sa-blocati-robotii-cu-robots-txt\/\" \/>\n<meta property=\"og:locale\" content=\"ro_RO\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"How to Block Bots with Robots.txt?\" \/>\n<meta property=\"og:description\" content=\"For an uninformed observer, a robot wandering around your website might seem like something out of a sci-fi movie. Believe it or not, it&#039;s far from\" \/>\n<meta property=\"og:url\" content=\"https:\/\/seo.london\/ro\/cum-sa-blocati-robotii-cu-robots-txt\/\" \/>\n<meta property=\"og:site_name\" content=\"SEO.London\" \/>\n<meta property=\"article:published_time\" content=\"2023-06-12T12:01:52+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2023-06-29T16:47:23+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/seo.london\/wp-content\/uploads\/2023\/06\/How-to-Block-Bots-with-Robots.png\" \/>\n\t<meta property=\"og:image:width\" content=\"800\" \/>\n\t<meta property=\"og:image:height\" content=\"449\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"author\" content=\"Lukasz Zelezny\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Scris de\" \/>\n\t<meta name=\"twitter:data1\" content=\"Lukasz Zelezny\" \/>\n\t<meta name=\"twitter:label2\" content=\"Timp estimat pentru citire\" \/>\n\t<meta name=\"twitter:data2\" content=\"11 minute\" \/>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"Cum se blocheaz\u0103 bo\u021bii cu Robots.txt? - SEO.London","description":"Un fi\u0219ier robots.txt este, \u00een esen\u021b\u0103, gardianul site-ului dumneavoastr\u0103. Acesta v\u0103 permite s\u0103 controla\u021bi ce p\u0103r\u021bi ale site-ului dvs. sunt disponibile pentru explorarea robo\u021bilor.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/seo.london\/ro\/cum-sa-blocati-robotii-cu-robots-txt\/","og_locale":"ro_RO","og_type":"article","og_title":"How to Block Bots with Robots.txt?","og_description":"For an uninformed observer, a robot wandering around your website might seem like something out of a sci-fi movie. Believe it or not, it's far from","og_url":"https:\/\/seo.london\/ro\/cum-sa-blocati-robotii-cu-robots-txt\/","og_site_name":"SEO.London","article_published_time":"2023-06-12T12:01:52+00:00","article_modified_time":"2023-06-29T16:47:23+00:00","og_image":[{"width":800,"height":449,"url":"https:\/\/seo.london\/wp-content\/uploads\/2023\/06\/How-to-Block-Bots-with-Robots.png","type":"image\/png"}],"author":"Lukasz Zelezny","twitter_card":"summary_large_image","twitter_misc":{"Scris de":"Lukasz Zelezny","Timp estimat pentru citire":"11 minute"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/seo.london\/fi\/how-to-block-bots-with-robots-txt\/","url":"https:\/\/seo.london\/how-to-block-bots-with-robots-txt\/","name":"Cum se blocheaz\u0103 bo\u021bii cu Robots.txt? - SEO.London","isPartOf":{"@id":"https:\/\/seo.london\/fi\/#website"},"primaryImageOfPage":{"@id":"https:\/\/seo.london\/how-to-block-bots-with-robots-txt\/#primaryimage"},"image":{"@id":"https:\/\/seo.london\/how-to-block-bots-with-robots-txt\/#primaryimage"},"thumbnailUrl":"https:\/\/seo.london\/wp-content\/uploads\/2023\/06\/How-to-Block-Bots-with-Robots.png","datePublished":"2023-06-12T12:01:52+00:00","dateModified":"2023-06-29T16:47:23+00:00","author":{"@id":"https:\/\/seo.london\/fi\/#\/schema\/person\/a87f13cbf62c630a697ac094314f9e25"},"description":"Un fi\u0219ier robots.txt este, \u00een esen\u021b\u0103, gardianul site-ului dumneavoastr\u0103. Acesta v\u0103 permite s\u0103 controla\u021bi ce p\u0103r\u021bi ale site-ului dvs. sunt disponibile pentru explorarea robo\u021bilor.","breadcrumb":{"@id":"https:\/\/seo.london\/how-to-block-bots-with-robots-txt\/#breadcrumb"},"inLanguage":"ro-RO","potentialAction":[{"@type":"ReadAction","target":["https:\/\/seo.london\/how-to-block-bots-with-robots-txt\/"]}]},{"@type":"ImageObject","inLanguage":"ro-RO","@id":"https:\/\/seo.london\/how-to-block-bots-with-robots-txt\/#primaryimage","url":"https:\/\/seo.london\/wp-content\/uploads\/2023\/06\/How-to-Block-Bots-with-Robots.png","contentUrl":"https:\/\/seo.london\/wp-content\/uploads\/2023\/06\/How-to-Block-Bots-with-Robots.png","width":800,"height":449,"caption":"How to Block Bots with Robots.txt"},{"@type":"BreadcrumbList","@id":"https:\/\/seo.london\/how-to-block-bots-with-robots-txt\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/seo.london\/fr\/"},{"@type":"ListItem","position":2,"name":"How to Block Bots with Robots.txt?"}]},{"@type":"WebSite","@id":"https:\/\/seo.london\/fi\/#website","url":"https:\/\/seo.london\/fi\/","name":"SEO.London","description":"SEO Consultant \u0219i expert SEO \u00een Londra, Marea Britanie - Lukasz Zelezny","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/seo.london\/fi\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"ro-RO"},{"@type":"Person","@id":"https:\/\/seo.london\/fi\/#\/schema\/person\/a87f13cbf62c630a697ac094314f9e25","name":"Lukasz Zelezny","image":{"@type":"ImageObject","inLanguage":"ro-RO","@id":"https:\/\/seo.london\/fi\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/55d18e132c3d0d63f7cd047da2d2a7f805a3392a84a615be5d6dca867281758e?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/55d18e132c3d0d63f7cd047da2d2a7f805a3392a84a615be5d6dca867281758e?s=96&d=mm&r=g","caption":"Lukasz Zelezny"},"description":"#1 Consultant SEO care locuie\u0219te \u00een Londra, care a lucrat cu companii precum Zoopla, uSwitch, Mashable, Thomson Reuters \u0219i multe altele. Angaja\u021bi-l pe Lukasz Zelezny (MCIM, F IDM)","url":"https:\/\/seo.london\/ro\/author\/lukasz-zelezny\/"}]}},"_links":{"self":[{"href":"https:\/\/seo.london\/ro\/wp-json\/wp\/v2\/posts\/31157","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/seo.london\/ro\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/seo.london\/ro\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/seo.london\/ro\/wp-json\/wp\/v2\/users\/6"}],"replies":[{"embeddable":true,"href":"https:\/\/seo.london\/ro\/wp-json\/wp\/v2\/comments?post=31157"}],"version-history":[{"count":0,"href":"https:\/\/seo.london\/ro\/wp-json\/wp\/v2\/posts\/31157\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/seo.london\/ro\/wp-json\/wp\/v2\/media\/31181"}],"wp:attachment":[{"href":"https:\/\/seo.london\/ro\/wp-json\/wp\/v2\/media?parent=31157"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/seo.london\/ro\/wp-json\/wp\/v2\/categories?post=31157"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/seo.london\/ro\/wp-json\/wp\/v2\/tags?post=31157"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}