# # robots.txt # # This file is to prevent the crawling and indexing of certain parts # of your site by web crawlers and spiders run by sites like Yahoo! # and Google. By telling these "robots" where not to go on your site, # you save bandwidth and server resources. # User-agent: * # Sitemap Sitemap: http://airburners.com/sitemap.xml # WordPress specific directoires and files Disallow: /wp-content/plugins/ Disallow: /wp-admin Disallow: /wp-includes Disallow: /readme.html # Thank you pages Disallow: /contact-us/thank-you Disallow: /job-openings/thank-you Disallow: /pricing-overview__trashed/thank-you Disallow: /price-quotation-request/thank-you # Miscellaneous Disallow: /tmp/ # Other User-agents User-agent: BaiduSpider Disallow: / User-agent: Copernic Disallow: / User-agent: Hangzhou Disallow: / User-agent: Alibaba Disallow: / User-agent: Hangzhou Alibaba Advertising Co.,Ltd. Disallow: / User-agent: Aliyun Disallow: /