User-agent: * Disallow: /category Disallow: /archives Disallow: /page Disallow: /m/category Disallow: /m/archives Disallow: /m/comment Disallow: /m/trackback Disallow: /m/lazy Disallow: /m/resources Disallow: /m/tag Disallow: /m/page User-agent: Baiduspider Disallow: / User-agent: R6_CommentReader Disallow: / User-agent: SISTRIX Crawler Disallow: / User-agent: Exabot Disallow: / User-agent: FlipboardProxy Disallow: / User-agent: Q_BlogBot Disallow: / User-agent: QT_BlogBot Disallow: / User-agent: YandexBot Disallow: / User-agent: NKBot Disallow: / # for Google GDN (Not Crawl) User-agent: Mediapartners-Google Allow: /