User-agent: Mediapartners-Google* Disallow: User-agent: * # All spiders should avoid Disallow: /cgi-bin/ # Script files Disallow: /mt-vast/ # Prive Disallow: /kasteel/ # Prive Disallow: /kasteeltje/ # Prive Disallow: /pivotlog/ # Prive Disallow: /templates/ # Prive Disallow: /wrk/ # Prive