# robots.txt fuer http://www.hanfthal.at/ # Suchmaschinen, die nicht die Site durchsuchen sollen. User-agent: appie Disallow: / User-agent: betaBot Disallow: / User-agent: BotOnParade Disallow: / User-agent: CatchBot Disallow: / User-agent: Charlotte Disallow: / User-agent: http://www.almaden.ibm.com/cs/crawler Disallow: / User-agent: ConveraCrawler Disallow: / User-agent: daumoa Disallow: / User-agent: dotbot Disallow: / User-agent: e-SocietyRobot Disallow: / User-agent: Exabot Disallow: / User-agent: Findlinks Disallow: / User-agent: GigaBot Disallow: / User-agent: girafa Disallow: / User-agent: Googlebot-Image Disallow: / User-agent: grub-client Disallow: / User-agent: Heritrix Disallow: / User-agent: Herold Disallow: / User-agent: ia_archiver Disallow: / User-agent: iCCrawler Disallow: / User-agent: larbin Disallow: / User-agent: Jyxobot Disallow: / User-agent: LinkWalker Disallow: / User-agent: Miva Disallow: / User-agent: MJ12bot Disallow: / User-agent: MLBot Disallow: / User-agent: msrbot Disallow: / User-agent: NaverBot Disallow: / User-agent: NG/2.0 Disallow: / User-agent: Nutch Disallow: / User-agent: psbot Disallow: / User-agent: Qseero Disallow: / User-Agent: Rankivabot Disallow: / User-Agent: Scooter Disallow: / User-agent: ScoutJet Disallow: / User-agent: seekbot Disallow: / User-agent: SeznamBot Disallow: / User-agent: Speedy Disallow: / User-agent: SurveyBot Disallow: / User-agent: SygolBot Disallow: / User-agent: Teoma Disallow: / User-agent: thesubot Disallow: / User-agent: Toplistbot Disallow: / User-agent: TurnitinBot Disallow: / User-agent: Twiceler Disallow: / User-agent: VoilaBot Disallow: / User-agent: Yandex Disallow: / User-agent: YaCy Disallow: / User-agent: Yahoo-MMCrawler Disallow: / User-agent: Yeti Disallow: / # Alle anderen Suchmaschinen sind erlaubt, aber mit Einschraenkungen. User-agent: * Disallow: /cgi-bin/ Disallow: /events/gfx/ Disallow: /kontakte/gaestebuecher.html Disallow: /kontakte/kontakte.html Disallow: /galerie/ Disallow: /gfx/ Disallow: /stats/ Disallow: /ufc/gfx/ Disallow: /ufc/portraets/ Disallow: /ufc/spielfotos/ Disallow: /vereine/gfx/ Disallow: /vereine/musik/ Disallow: /woze/ Disallow: /401.html Disallow: /403.html Disallow: /404.html Disallow: /500.html