# Indexing / Crawling Bots, block duplicate content & dynamic pages User-agent: * Disallow: Disallow: /action/admin*? Disallow: /action/login*? Disallow: /action/register*? Disallow: /action/forgotten_password*? Disallow: /action/import_account*? Disallow: /action/pm*? Disallow: /action/chat*? Disallow: *?/action/post*? Disallow: *?/action/markasread*? Disallow: *?/action/print*? Disallow: *?/action/search*? Disallow: *?/action/recent*? Disallow: *?/action/members*? Disallow: /tmp/ # these will soon disappear # Google AdSense User-agent: Mediapartners-Google* Disallow: Allow: /* # Bots with high numbers of requests User-agent: dotbot Disallow: /