Meta Robots Tags Meta Robots All Robots.txt Robots META tag
We can control the search engines spiders with the help of robots.txt, and certain pages should not be indexed and not be followed by search engine robots. The Robots META tag, placed in the HTML <HEAD> section of a page, can specify either or both of these actions.
The default values are now assumed to be INDEX, FOLLOW, ARCHIVE, ODP, SNIPPET and YDIR.
Examples
<HEAD>
<title>SEO Robots Meta Tag </title>
<META name="robots" content="NOINDEX,NOFOLLOW" />
</HEAD>
<HEAD>
<title> SEO Robots Meta Tag </title>
<META name="googlebot" content="NOARCHIVE, NOODP, NOSNIPPET" />
<META name="slurp" content="NOARCHIVE, NOYDIR, NOSNIPPET" />
</HEAD>
| Task | Entry |
|---|---|
| Indexer: ignore content; Robot: follow links | <META name="ROBOTS" content="NOINDEX"> |
| Indexer: include content; Robot: do not follow links | <META name="ROBOTS" content="NOFOLLOW, INDEX "> |
| Indexer: ignore content; Robot: do not follow links | <META name="ROBOTS" content="NOINDEX,NOFOLLOW"> |
| Indexer: include content; Robot: follow links | <META name="ROBOTS" content="INDEX,FOLLOW"> |
| Search results pages should not show "cache" link | <META name="ROBOTS" content="NOARCHIVE"> |
| Search results pages should not display the Open Directory Project (ODP) title and description for the page. | <META name="ROBOTS" content="NOODP"> Danny Sullivan provides good examples of how outdated descriptions and even titles show up when the ODP content is used for search results. |
| Search results pages should not display the Yahoo Directory title and description for the page | <META name="ROBOTS" content="NOYDIR"> (Yahoo Slurp robot only) |
| Search results pages should not display any description or text context for this page. Title only, I guess. | <META name="ROBOTS" content="NOSNIPPET"> |
Posts
No comments:
Post a Comment