.Google.com limits robots.txt help to four industries, clarifying its own position on unsupported ordinances.Google simply supports 4 details robots.txt fields.Unsupported directives in robots.txt are going to be actually disregarded.Think about auditing your robots.txt reports because of this improve.