.Google confines robots.txt help to four industries, clarifying its own standpoint on unsupported instructions.Google just supports four details robots.txt areas.Unsupported regulations in robots.txt will definitely be neglected.Look at bookkeeping your robots.txt data in light of this improve.