WP博客怎么写robots.txt ，WordPress写robots.txt方法

WP博客怎么写robots.txt ，WordPress写robots.txt方法

WP博客怎么写robots.txt ，WordPress写robots.txt方法

复杂方法

User-agent: *

# disallow all files in these directories

Disallow: /cgi-bin/

Disallow: /z/j/

Disallow: /z/c/

Disallow: /stats/

Disallow: /dh_

Disallow: /about/

Disallow: /contact/

Disallow: /tag/

Disallow: /wp-admin/

Disallow: /wp-includes/

Disallow: /contact

Disallow: /manual

Disallow: /manual/*

Disallow: /phpmanual/

Disallow: /category/

Disallow: /wp-

Disallow: /feed/

Disallow: /trackback/

Disallow: */feed*

Disallow: */trackback

User-agent: Googlebot

# disallow all files ending with these extensions

Disallow: /*.php$

Disallow: /*.js$

Disallow: /*.inc$

Disallow: /*.css$

Disallow: /*.gz$

Disallow: /*.wmv$

Disallow: /*.cgi$

Disallow: /*.xhtml$

# disallow all files with ? in url

Disallow: /*?*

# disable duggmirror

User-agent: duggmirror

Disallow: /

# allow google image bot to search all images

User-agent: Googlebot-Image

Disallow:

Allow: /*

# allow adsense bot on entire site

User-agent: Mediapartners-Google*

Disallow:

Allow: /*

简单方法

User-agent: *

Disallow: /wp-admin/

Disallow: /wp-content/

Disallow: /feed

Disallow: /comments/feed

Disallow: /trackback

去动态方法

Disallow: /?p=

Disallow: /?tag=

Disallow: /?s=

Disallow: /wp-

Disallow: /feed

www.2tyb.com整理发布技术支持www.dsza.net