Like the Sitemap plugin, Txt plugin also works out of the box and does not require any direct development to operate.

Adding the Txts to Web Pages

• In addition to the generated Txts you may also want to add meta tags in pages of your web app. Components have not been added in the plugin to automatically generate this as it is a trivial task. Here's how you can do it:

To point the location of humans.txt, add

<link type="text/plain" rel="author" href="{{ '/'|app }}/humans.txt" />

To prevent a page from being indexed, add

<meta name="robots" content="nofollow, noindex">

The terms all, index ,nofollow, noindex may be used as per the W3C's standards. But there are search engines that consider other terms as well. Here’s a list of possible terms:

index

Allow search engines robots to index the page, you don’t have to add this to your pages, as it’s the default.

noindex

Disallow search engines from showing this page in their results.

noimageindex

Disallow search engines from spidering images on that page. Of course if images are linked to directly from elsewhere, Google can still index them, so using an X-Robots-Tag HTTP header is a better idea.

none

This is a shortcut for noindex,nofollow, or basically saying to search engines: don’t do anything with this page at all.

follow

Tells the search engines robots to follow the links on the page, whether it can index it or not.

nofollow

Tells the search engines robots to not follow any links on the page at all.

noarchive

Prevents the search engines from showing a cached copy of this page.

nocache

Same as noarchive, but only used by MSN/Live.

nosnippet

Prevents the search engines from showing a snippet of this page in the search results and prevents them from caching the page.

noodp

Blocks search engines from using the description for this page in DMOZ (aka ODP) as the snippet for your page in the search results.

noydir

Blocks Yahoo! from using the description for this page in the Yahoo! directory as the snippet for your page in the search results. No other search engines use the Yahoo! directory for this purpose, so they don’t support the tag.