????? ???? ???? ?? (robots.txt ??? meta robots ??? ???)

????? ???? ???? ??
??? ??? robots.txt
??? ??? < meta name="robots" content="noindex">

????? ?? ???? ?? ????? ????? ???? ???? ???? ???? ??? ?? ??? ??????, ???? ??? ??? ???? ? ???? ??? ??? ??? ?? ???.
?? ??? ??? ?? ???? ???? ???? ?? ???? ?? ????.
???? ???? ??? ???? ??? ??? ??? ????? ??? ???? ??? ??, ???? ??? ??? ????? ????? ???? ?? ??? ?? ???? ??? ?? ?? ????? ??? ???.

????? ???? ???? ??? ???? ???? ??? ????.
???? ????? ???? ?? ????? robots.txt ??? ???? ???? ??,
???? ????? ??? ??? ?? < meta name="robots" content="noindex,nofollow"> ?? ?? ?? ??? ???? ???? ???.

robots.txt ??? ???? ???? ???? ??

????? robots.txt ??? ???? ?? ????? ??? ???.
?? ?? ????? http://www.seo-korea.com/robots.txt ? ???? ??? ??? ??? ???.
http://www.seo-korea.com/myfolder/robots.txt ? ???? ????.

????? ???? ?? ?? ????? ????? ??? ?? ??? robots.txt? ?????.
User-agent: *
Disallow: /

??? ?? ??? ?????
User-agent: *
Disallow:

?? ???? ?????
User-agent: *
Disallow: /members/
Disallow: /search/
Disallow: /images/

?? ???? ???? ????? (??? ??)
User-agent: Googlebot
Disallow: /

?? ?? ???? ???? ????? (??? ??)
User-agent: Google
Disallow:
User-agent: *
Disallow: /

?? ???? ?????
User-agent: *
Disallow: /members/personal_info.html

robots.txt ??? ???? ??
User-agent: *
Disallow:
Sitemap: http://www.seo-korea.com/sitemap.xml

meta robots ??? ???? ???? ???? ??

< meta name="robots" content="..." /> ??? ???? ????? ???? ? ???? < head>? ??? ?????.
?? ??? content ?? index, noindex, follow, nofollow ? ????.
index? noindex? ???? ??? ??? ???? follow, nofollow? ????? ??? ???? ???? ??? ???? ??? ?????.
index? noindex? ?? ??? follow? nofollow? ??? ??? ?? ???? ????.

? ??? < meta name="robots"> ??? ???? index? follow?? ??? ?? ???? ???? ????.
< meta name="robots" content="index,follow" />
< meta name="robots" content="index,nofollow" />
< meta name="robots" content="noindex,follow" />
< meta name="robots" content="noindex,nofollow" />

robots.txt ??? meta robots ??? ???? ???? ??

?? ???? ? ???? ????? ??? ??? ????? ????? ???? ??, ???? ??? ??? ??? ?? ??? ?? ????.
??? robots.txt? meta robots ??? ??? ?? ???? ??? ?? ??? ????? ????.
?? ???? ?? ???? ???? ?? ??? ???? ??? ???? ?? ??? ???? ??? ?? ??? ??? ??? ????? ????.

??? ??, ??? ??

robots.txt? ???? ??? ????? meta robots ??? ???? ???? ?? ????.
???? ??? ???? ????? ??? ??? ??? meta robots ??? ?????.
???? ??? ??? ???? ????? ????? ??? meta robots ???? ???? ????? ???? ????? ???, ???? ???? ????? ?? ???? ???.
? ??? ?????? ??? ????? ?? ???? ?????.

??? ??, ??? ??

?? ?? ?? ???? ????? ???? ???? ????.
???? ???? robots.txt??? ?? ?? ??? ?? ???? ???? ??? ????.
???? ???? ?????? ????? ???? ?? ????.
??? robots.txt???? ???? ?????? ???? ???? ????? ????? ???? ??? ?? ????.
??? ??? ?? ????? ???? ???? ??? ?? ???? ???? ?????.
???? ?????? ?? ???? ????? ??? ??? ??? ?? ???? ??? ??? ????? ?????.
???? ????? ????? ??? ??? ?? URL? ??? ?? ???(????? ????)?? ???? ??? ?? ???.
?? robots.txt ??? ???? ????? ?? ??? ????? ??? ??? ???? ?????? ???, ???? ?????? ?? ???? ??? ?? ????.

??? ??, ??? ??

?? ??? ???? ??? ??? ??? ???? ?? ???? ????? ??? ??? ???? ?? ????.
???? ???? ????? ??? ???? ???? ?? ?? ????.
??? [??? ??, ??? ??]? ??? ????? ???? ???? ?? ??? ????? ??? ????.
??? ????? ???? ?? ?? ????? ????? URL?, ???(????? ????)?? ???? ??? ?? ???.
?? ???? ???? ?? ????? ??? ???? ???? ???? ???? ??? ????.

?????? ???? ??? ?? ?? ?? ??? ???? ???? ???? ???? ????.
??? ???? ???? ????? ?? ???? ?? ?? ????? ???? ???.
??? ??? ???? ???? ??, ??? robots.txt ??? meta robots ??? ????? ? ??? ??, ???? ???? ??? < meta name="robots" content="noindex"> ? robots.txt?? ??? ???? ???? ???.