跟随我们?你可以在Twitter上找到我们: @slboat

手册:robots.txt

来自森亮号航海见识 {SLboat Insight;}
跳转至: 导航搜索

官方wiki参考

With short URLs It is easy to prevent spiders from indexing non-article pages if you are using Wikipedia-style short URLs. Assuming articles are accessible through /wiki/Some_title and everything else is available through /w/index.php?title=Some_title&someoption=blah:

User-agent: *
Disallow: /w/

Be careful, though! If you put this line by accident:

Disallow: /w

you'll block access to the /wiki directory, and search engines will drop your wiki!

简要说明

使用这个:

User-agent: *
Disallow: /w/

千万不要这个:

Disallow: /w

不然会拒绝所有搜索引擎