User-agent:naverbot Disallow: / User-agent: yandex Disallow: / User-agent: yanga Disallow: / User-agent: TheRarestParser Disallow: / User-agent: SeznamBot Disallow: / User-agent: Robozilla Disallow: / User-agent: psbot Disallow: / User-agent:OmniExplorer_Bot Disallow: / User-agent: http://www.almaden.ibm.com/cs/crawler Disallow: / user-agent: szukacz disallow: / User-Agent: Whizbang Disallow: / User-agent: NextGenSearchBot Disallow: / User-agent: MJ12bot Disallow: / User-Agent: Charlotte Disallow: / User-agent: MLBot Disallow: / User-agent:JadynAve Disallow: / User-agent: discobot Disallow: / User-Agent: NetResearchServer Disallow: / user-agent: * disallow: /Categories/ disallow: /categories/ disallow: /Weather/ disallow: /weather/ disallow: /Admin/ disallow: /admin/ disallow: /Merchant/ disallow: /merchant/ disallow: /Security/ disallow: /security/ disallow: /Search/ disallow: /search/ disallow: /Naughty/ disallow: /naughty/ user-agent: twiceler Disallow: /