Using the X-Robots-Tag
HTTP header
The
X-Robots-Tag
can be used as an element of the HTTP header response for a given URL. Any directive that can be used in a robots meta tag can also be specified as anX-Robots-Tag
.
Source: Using the X-Robots-Tag
HTTP header.