To stay away from undesirable content during the research indexes, webmasters can instruct spiders never to crawl specified files or directories from the typical robots.txt file in the root Listing on the area. Moreover, a webpage can be explicitly excluded from the internet search engine's database by using a meta tag precise to robots (usually ).