#User-agent: * #Disallow: / User-Agent: * Disallow: /uploads/ Disallow: /typo3temp/ Disallow: /typo3conf/ allow: /uploads/media/ #2015-03-25 User-agent: XoviBot Disallow: / User-agent: MegaIndex.ru Disallow: / User-agent: MegaIndex.ru/2.0 Disallow: / #2015-03-30 User-agent: Mozilla/5.0 (compatible; MegaIndex.ru/2.0; +https://www.megaindex.ru/?tab=linkAnalyze) Disallow: /