MediaWiki talk:Robots.txt
Latest comment: 15 years ago by Mike.lifeguard in topic Robot exclusion list standards: path variations
Robot exclusion list standards: path variations
editNow, correct me if I'm wrong, but any given /path includes its /path/ and /path/variants, so they won't need separate listings.
You should be able to remove these without impacting results:
- Disallow: /wiki/Commons:Changing_username/
- Disallow: /wiki/Commons%3AChanging_username/
- Disallow: /wiki/Commons_talk:Changing_username/
- Disallow: /wiki/Commons_talk%3AChanging_username/
Input from web-talented types requested. Kylu (talk) 23:13, 17 September 2008 (UTC)
- I had thought so myself, so Done & thanks. — Mike.lifeguard | @en.wb 23:48, 17 September 2008 (UTC)