ʹHTML<META>ǩNAMEУֵùؼkeywordsdescriptionҳݣԼ㣬Ҳ֤Чܿ
<META NAME="keywords" CONTENT=",more about it"> <META NAME="description" CONTENT=",more about it">
ԼһROBOTS <META NAME="ROBOTS" CONTENT="INDEX,FOLLOW"> ʾԽҳ棬ӱҳеijӵҳȥΪ㹫˾ҳ˵
ROBOTS趨ɲοһ
http://www.w3.org/Search/9605-Indexing-Workshop/ReportOutcomes/Spidering.txt żEIJãһû˵ :
1. ROBOTS meta-tag
<META NAME="ROBOTS" CONTENT="ALL | NONE | NOINDEX | NOFOLLOW">
default = empty = "ALL" "NONE" = "NOINDEX, NOFOLLOW"
The filler is a comma separated list of terms: ALL, NONE, INDEX, NOINDEX, FOLLOW, NOFOLLOW.
Discussion: This tag is meant to provide users who cannot control the robots.txt file at their sites. It provides a last chance to keep their content out of search services. It was decided not to add syntax to allow robot specific permissions within the meta-tag.
INDEX means that robots are welcome to include this page in search services.
FOLLOW means that robots are welcome to follow links from this page to find other pages.
So a value of "NOINDEX" allows the subsidiary links to be explored, even though the page is not indexed. A value of "NOFOLLOW" allows the page to be indexed, but no links from the page are explored (this may be useful if the page is a free entry point into pay-per-view content, for example. A value of "NONE" tells the robot to ignore the page.
|