.Google limits robots.txt support to 4 fields, clarifying its standpoint on unsupported directives.Google merely supports 4 particular robots.txt industries.In need of support ordinances in robots.txt are going to be disregarded.Consider bookkeeping your robots.txt files taking into account this improve.