# robots.txt for ARINC.com User-agent: * Disallow:/cgi-bin/ Disallow:/mdcis/ Disallow:/icons/ Disallow:/frequency_management/members_only/ Disallow:/Library/ Disallow:/cf/ Allow:/cf/store/ # SharePoint is a bad crawler User-agent: Mozilla/4.0 (compatible; MSIE 4.01; Windows NT; MS Search 4.0 Robot) Microsoft Disallow: / # go away SharePoint User-agent: Mozilla/4.0 (compatible; MSIE 6.0; Windows NT; MS Search 4.0 Robot) Disallow: /