Commons:Bots/Requests

Shortcut: COM:BRFA

If you want to run a bot on Commons, you must get permission first. To do so, file a request following the instructions below.

Please read Commons:Bots before making a request for bot permission.

I	Create a user account (while logged in to your normal account) and user page for the bot On the bot's userpage, add {{bot}}, which automatically adds the page to Category:Commons bots. Then add the following information to the bot's userpage (all this is mandatory): Operator: Who the creator/operator is and how they can best be contacted Tasks: Details of the bot's task or tasks Operation: Whether the bot is manually assisted or runs automatically When: When it operates (continuously, intermittently, or at specified intervals) Maximum edit rate: The bot's maximum edit rate (eg edits per minute) Language: The language and/or program that it is running
II	Create your bot request: Replace "YourBotName" with your bot's username in the box below and click the button. Complete the questions on the resulting page and save it. Remember that your bot will be allowed to operate only for those tasks that you have specified in your request. Add your bot request to the list here: Edit the following request list, adding the following text to the top of the appropriate section (replacing "YourBotName" with your bot's name): {{Commons:Bots/Requests/YourBotName}}
III	Test run Make a short test run with your bot account (30-50 edits/uploads) to allow other users to review your bot's tasks.
IV	Waiting for approval. You now need to wait for community approval. A bureaucrat will close the request and will also grant a bot flag, where necessary. Closed requests are moved to Commons:Bots/Archive.

Archives List all Requests Requests by closing date

Requests made on this page are automatically transcluded in Commons:Requests and votes for wider comment.

Requests for permission to run a botEdit

watch

Before making a bot request, please read the new version of the Commons:Bots page. Read Commons:Bots#Information on bots and make sure you have added the required details to the bot's page. A good example can be found here.

When complete, pages listed here should be archived to Commons:Bots/Archive.

Any user may comment on the merits of the request to run a bot. Please give reasons, as that makes it easier for the closing bureaucrat. Read Commons:Bots before commenting.

MBHbot (talk · contribs)Edit

Operator: MBH (talk · contributions · Number of edits · recent activity · block log · User rights log · uploads · Global account information)

Bot's tasks for which permission is being sought: renaming files with cyrillic/latin character mix in titles.

Automatic or manually assisted: every single launching (for specific character pair) will be done manually, then bot will perform this task automatically.

Edit type (e.g. Continuous, daily, one time run): periodical manual runs.

Maximum edit rate (e.g. edits per minute): as much as allowed. Using pywiki, potentially it can be up to 60 per minute.

Bot flag requested: (Y/N): Y.

Programming language(s): standard pywiki script movepages.py.

Wikimedia Commons contains several thousands of files with cyrillic/latin character mix in titles, here is a list. Many of them were bulk uploaded with the same error in title, for example files from Keukenhof with the cyrillic К in a latin name. I want to fix those cases through mass renaming using standard pywiki renamer. I used it many times earlier in other wikis, for example see 1 and 2. My bot has bot flag and 600 000 edits in ruwiki since 2011 and Chechen wiki since 2016. MBH (talk) 12:43, 23 May 2017 (UTC)

DiscussionEdit

• I think list for fixes should be created manually. For example: File:"Хлебопекарня" Иркутского полка в "Волчьих Ямах", посл. четв. XVIIв..JPG just need space. Adygh pronunciation files - addition of dash. DКамень-Великан files - removal of D. Etc. --EugeneZelenko (talk) 13:57, 23 May 2017 (UTC)
  • I'm planning to rename using bot only file sets with the same error, for example many files with "Кeukenhof" or "Cобор Исаакиевский" or "Zаbytk" or "Сhurch", "Сovent", "Сross" etc. (latin and cyrillic C are on the same keyboard key, so this is common error), one run for one word with specific error. MBH (talk) 14:21, 23 May 2017 (UTC)

    This criteria will be applied to File:"Хлебопекарня" Иркутского полка в "Волчьих Ямах", посл. четв. XVIIв..JPG, but it'll be wrong. --EugeneZelenko (talk) 15:05, 24 May 2017 (UTC)

    No, this criteria will not be applied to this title because it doesn't contain Russian word with alike-looking latin character or English (or another European) word with alike-looking cyrillic character. I want to rename only such errors, only words with wrong alike-looking character. Maybe I explain my intentions not clearly enough, English isn't my native language. MBH (talk) 16:18, 24 May 2017 (UTC)

• Which file rename criterion does apply to this task? --Krd 14:30, 23 May 2017 (UTC)
  • Sixth? MBH (talk) 14:40, 23 May 2017 (UTC)

Embedded Data Bot (talk · contribs) (alteration 2)Edit

Operator: Zhuyifei1999, Steinsplitter, Revent

Bot's tasks for which permission is being sought: Alteration of Commons:Bots/Requests/Embedded Data Bot (adminbot): When condition #4 (require only 1 single file revision) do not match, perform an overwrite with the embedded part truncated, and revision delete the bad revision.

@Jdx: observed that the pirates are now actively exploiting the condition to bypass immediate deletion. They even uploaded a tutorial on how to bypass it.

This condition was originally used to prevent anyone from abusing the bot to delete an arbitrary page; some crazy logic could be used to extend the scope of automated immediate deletion to any eligible page under COM:CSD#G7 (uploader request), but if the pirates were to overwrite someone else's file CSD G7 would not pass, allowing easy deletion bypassing.

Perform a revdel would discourage the pirates from using this method (though the time-to-revdel may still be longer than time-to-deletion due ti requiring an overwrite), but may unfortunately leave a trail of copyvios for manual deletion.

Automatic or manually assisted: Automatic unsupervised

Edit type (e.g. Continuous, daily, one time run): Continuous via RC

Maximum edit rate (e.g. edits per minute): Honestly, I don't know. The codebase is getting too complex.

Bot flag requested: (Y/N): N

Programming language(s): Python: Pywikibot

Zhuyifei1999 (talk) 09:28, 21 May 2017 (UTC)

DiscussionEdit

• Now test running. Revdel is not exactly stable due to requiring a refreshed file revision history after overwriting. The oldimage id won't be available until after overwrite. If things go wrong, the old {{embedded data}} tag would be applied. --Zhuyifei1999 (talk) 09:42, 21 May 2017 (UTC)

• I'd suggest not to publish details of further alterations in order to avoid easily working around. --Krd 15:29, 21 May 2017 (UTC)

  @Krd: If that's the case, is announcing them in phab:Z567 enough? --Zhuyifei1999 (talk) 15:35, 21 May 2017 (UTC)

  I'd say yes, although I was unable to follow the discussion, to be honest. Anyway, you're doing a fantastic job here, and I'm not aware of any unaddressed problems, so unless something goes seriously wrong I'd suggest to continue at your discretion. --Krd 16:04, 21 May 2017 (UTC)

AndreCostaWMSE-bot (talk · contribs)Edit

Operator: André Costa (WMSE) (talk · contributions · Number of edits · recent activity · block log · User rights log · uploads · Global account information)

Uploading freely licensed images from (primarily GLAM) collaborations with Wikimedia Sverige.

Bot's tasks for which permission is being sought: Image uploads

Automatic or manually assisted: Automatic

Edit type (e.g. Continuous, daily, one time run): one time run (well one time per batch)

Maximum edit rate (e.g. edits per minute): ~ 3/min

Bot flag requested: (Y/N): Y (needed for the upload_by_url bit)

Programming language(s): python (using the pywikibot framework)

André Costa (WMSE) (talk) 16:23, 17 May 2017 (UTC)

DiscussionEdit

This is the bot account I've started using for some of the bot work that I previously did for years with my volunteer bot account but which are now happening more in my role as an employee of Wikimedia Sverige (there are still also some GLAM specific bot accounts). Since the account switch happened on short notice this bot has actually already done a batch upload of National Gallery of Sweden paintings (info processing source code, upload source code).

The batch specific processing code for the next batch (images from the Cultural Heritage Board of Sweden) can be found here. The change between this and the other batches is that it will upload by url instead of from my local drive. /André Costa (WMSE) (talk) 16:23, 17 May 2017 (UTC)

Looks OK for me, but I think will be good idea if humans will participate to add subject related categories after uploads. --EugeneZelenko (talk) 14:25, 18 May 2017 (UTC)

I add maintenance categories to the cases where the categorisation is insufficient. We'll also try to have a drive to get people to give all of the images some love after they are uploaded but the results of that is of course outside of my control. /André Costa (WMSE) (talk) 13:33, 24 May 2017 (UTC)

• Which is the volunteer bot account mentioned above? --Krd 15:27, 21 May 2017 (UTC)

  Sorry. That would be User:L_PBot (and looking at the page I realise I haven't updated it since 2012 whereas the bot has been doing an increasing numeber of tasks since 2007). /André Costa (WMSE) (talk) 13:33, 24 May 2017 (UTC)

BartBotje (talk · contribs)Edit

Operator: Bj.schoenmakers (talk · contributions · Number of edits · recent activity · block log · User rights log · uploads · Global account information)

Bot's tasks for which permission is being sought: Uploading nature related images from plantennamen.info, waarneming.nl waarnemingen.be and observation.org (and other sites in the future in aid of the dutch nature wikiproject Dutch)

Automatic or manually assisted: Automatic when manually initiated

Edit type (e.g. Continuous, daily, one time run): One time runs at the discretion of the operator

Maximum edit rate (e.g. edits per minute): avg. 10 per minute

Bot flag requested: (Y/N): Y

Programming language(s): Perl using: MediaWiki::Bot and MediaWiki::API

Bj.schoenmakers (talk) 21:10, 23 April 2017 (UTC)

DiscussionEdit

This bot already has a botflag for the Dutch wikipedia. I want to be able to use it for uploading image batches and as a back-end for a tool i'm creating, allowing users of waarneming.nl, waarnemingen.be and observado.org (sites for nature observations) to publish media to commons using the correct copyright/attribution etc.

•  Support. For plantennamen we have a valid OTRS-ticket (ticket:2017031610007597). Bot owner knows what he is doing and the pics at the sites mentioned are great. Natuur12 (talk) 23:18, 23 April 2017 (UTC)

• Please make a few test edits. --Krd 06:33, 24 April 2017 (UTC)

• Ok, did a few test-uploads in Category:Images from plantennamen.info

  Please enclose author name in language tag. --EugeneZelenko (talk) 14:18, 25 April 2017 (UTC)

• Please make dates complaint with {{ISOdate}} in the {{Information}} template to allow for multilingual dates. Example: |date=Tue Apr 25 01:16:25 2017 changed to |date=2017-04-25 01:16:25~riley (talk) 23:32, 25 April 2017 (UTC)
•  Question Why doesn't plantennamen have the author's name anywhere? It makes your template statement "This permission only extends to photos taken by Maarten van der Veer at this link." very hard to interpret, because I can't see who any of the photos are by. --99of9 (talk) 02:09, 26 April 2017 (UTC)
  • There is a slight problem with the ticket. Most likely outcome: we will have too delete the test uploads from plantennamen. I will leave some detailed notes at the ticket in some days too explain what went wrong. Natuur12 (talk) 19:58, 26 April 2017 (UTC)
    • I nuked the uploads from Plantennamen. It turns out that this person didn't take at least a significant amount of the photographs himself. This was only found out after an extensive check off the test uploads. Most uploads contained consistent EXIF but some didn't. Perhaps we can still hoste some off the files in the future but not this day and given the situation not any day soon. Natuur12 (talk) 13:55, 2 May 2017 (UTC)
      • Always ask at least one question :). Thanks for investigating Natuur12. --99of9 (talk) 00:00, 3 May 2017 (UTC)
• I'd be happy to see test uploads from the other sites. --99of9 (talk) 02:14, 26 April 2017 (UTC)
  • I did some test uploads from waarneming.nl, waarnemingen.be and observations.org :

Natrix natrix (Colubridae) (European Grass Snake), Biebrza NP, Poland.jpg
Alces alces (Cervidae) (Eurasian elk), Biebrza NP, Poland.jpg
Eysarcoris venustissimus (Pentatomidae) (Woundwort Shieldbug) - (imago), Elst (Gld), the Netherlands - 2.jpg
Eysarcoris venustissimus (Pentatomidae) (Woundwort Shieldbug) - (imago), Elst (Gld), the Netherlands.jpg
Harmonia axyridis f. succinea (Coccinellidae) - (imago), Elst (Gld), the Netherlands.jpg
Diurnea fagella (Chimabachidae) - (imago), Elst (Gld), the Netherlands.jpg
Lophophanes cristatus (Paridae) (European Crested Tit) - (adult), Oberengadin, Switzerland.jpg
Pseudoips prasinana (Nolidae) (Green Silver-lines) - (imago), Zemst, Belgium.jpg
Bombylius major (Bombyliidae) (Dark-edged Bee-fly) - (imago), Arnhem, the Netherlands.jpg
Ommatoiulus sabulosus (Julidae) (Striped Millipede), Molenhoek, the Netherlands.jpg

Bj.schoenmakers (talk) 11:12, 8 May 2017 (UTC)

• The latest upload contains {{LicenseReview}}. Ca we assume that the bot checked the license before the upload, can we consider this reviewed? --Krd 15:24, 21 May 2017 (UTC)

MidleadingBot (talk · contribs)Edit

Operator: Midleading (talk · contributions · Number of edits · recent activity · block log · User rights log · uploads · Global account information)

Bot's tasks for which permission is being sought: Batch upload files.

Automatic or manually assisted: Manually prepare the file list and files.

Edit type (e.g. Continuous, daily, one time run): Task

Maximum edit rate (e.g. edits per minute): upload: Depends on network, but usually two or one upload per min. edit: 6 per min

Bot flag requested: (Y/N): Y(management of files, query in batch of 5000 instead of 500)

Programming language(s): C#

Midleading (talk) 09:21, 13 May 2017 (UTC)

DiscussionEdit

• "Batch upload files" is very general. What files will be uploaded? Only scans of old books? // 你所说的“批量上传”太宽泛。有哪些文件将会被上传？只有古代书籍的扫描吗？ --Zhuyifei1999 (talk) 09:43, 13 May 2017 (UTC)

Yes.是的。--Midleading (talk) 11:56, 13 May 2017 (UTC)

• Definitely information related to copyrights is missing in descriptions. Language tags should be used too. --EugeneZelenko (talk) 14:29, 13 May 2017 (UTC)

There is a total list of uploads at zh:s:Special:PermanentLink/863487. It is about ~10 GB and ~2k files. All books are in the public domain. Description and detailed version information of each book is also provided in that table. Due to many volumes of a book may refer to the same description, it needs some time to associate these descriptions with each file, and re-debug of bot. I was thinking about adding these descriptions with another bot edit because it is easier to write a script to do text editing than uploading. I will fix the descriptions once I finish uploading or when I have written the code to update the info. I was running the bot because it uploads so slowly that it has very little impact on patrollers.--Midleading (talk) 16:10, 13 May 2017 (UTC)

Alternatively you could generate the all description before uploading, and then let us check a few to see if they are okay. Also would you mind adding some interwiki links to the description pages? (eg the source of File:A1746：方苞望溪先生集12-09.djvu could link to zh:四部叢刊.) Regarding scope and copyright LGTM. --Zhuyifei1999 (talk) 16:42, 13 May 2017 (UTC)

I have associated the descriptions and the files uploaded so far(about ~1K files). The descriptions are deployed by MidleadingBot on Wikisource now. An example is zh:s:Index:A0042：尔雅.djvu. The description is placed below the cover of the book. I can use my database to associate the files and descriptions on commons as well with this bot. 至于文件链接至维基百科，我觉得没有必要，因为分类已经链接至维基百科了，如果一定要链接，文件应当链接至相应的作者，而不是四部丛刊。--Midleading (talk) 02:29, 14 May 2017 (UTC)

然而我并没有看到Category:四部叢刊初編或者Category:四部叢刊集部有维基百科链接。链接作者当然也行，有总比没有好 --Zhuyifei1999 (talk) 04:22, 14 May 2017 (UTC)

请注意父分类Category:四部叢刊--Midleading (talk) 04:53, 14 May 2017 (UTC)

剛才我檢查了維基百科，發現以下作者已建立維基百科條目：

岑參，崔豹，常璩，戴復古，戴良，戴表元，戴震，晁公武，晁補之，晁說之，曹植，曾國藩，曾慥，曾鞏，查慎行，查繼佐，班固，白居易，程敏政，蔡邕，鄧析，長孫無忌，陳子昂，陳師道，陳彭年，陳思，陳淵，陳獻章，陳維崧，陳與義，鮑照，伏勝，房玄齡，房祺，方孝孺，方苞，杜光庭，杜牧，杜甫，杜預，歸有光，段成式，獨孤及，竇常，范仲淹，范成大，范甯，葛洪，董仲舒，郭忠恕，郭璞，郭茂倩，郭象，韓非，顧炎武，馮贄，高仲武，高啟，高誘，高適，龔自珍，何休，何晏，姜尚，嵇康，忽思慧，桓寬，江淹，洪亮吉，洪咨夔，皇甫冉，皇甫湜，胡安國，胡曾，計有功，許慎，許謙，賈島，賈思勰，賈昌朝，賈誼，韓偓，韓嬰，韓愈，駱賓王，黃宗羲，黃帝，黃庭堅，黃溍，黃滔，京房，劉克莊，劉向，劉基，劉安，劉安世，劉徽，劉恕，劉敞，劉熙，劉蛻，劉邵，厲鶚，孔元措，孔穎達，孔鮒，寇準，揭傒斯，李中，李商隱，李復言，李德裕，李昉，李白，李群玉，李翺，李覯，李隆基，李頻，林逋，焦贛，酈道元，劉勰，劉因，劉歆，劉知幾，劉禹錫，劉義慶，呂本中，呂溫，呂祖謙，墨子，孟浩然，孟郊，柳宗元，柳開，梅堯臣，歐陽脩，毛亨，盧仝，穆修，繆荃孫，羅隱，陸九淵，陸德明，陸機，陸賈，陸贄，陸雲，陸龜蒙，馬令，全祖望，商鞅，彭孫貽，權德輿，歐陽詹，沈亞之，沈括，沈約，沈遼，皮日休，秦觀，邵雍，錢大昕，錢若水，錢謙益，錢起，阮閱，司空圖，司馬光，唐庚，唐慎微，唐順之，宋濂，汪中，汪琬，汪藻，王九思，王充，王冰，王勃，王十朋，王士元，王夫之，王安石，王弼，王明清，王符，王若虛，田穰苴，蘇洵，蘇舜欽，蘇軾，蘇轍，陶宗儀，陶弘景，陶潛，吳偉業，吳兢，吳寬，吳縝，吴起，徐枋，徐賁，徐鍇，徐陵，文同，文天祥，王叔和，王士禛，王應麟，王澍，王灼，王炎午，王禹偁，王維，王肅，王通，王逸，王陽明，蕭統，謝朓，謝枋得，邢昺，韋昭，魏，魏了翁，魏徵，元稹，姚合，姚燧，姚鉉，姚鼐，尹文，尹洙，庾信，徐夤，應劭，揚雄，晏子，楊倞，楊基，楊時，楊維楨，楊衒之，殷璠，耶律楚材，荀悅，虞集，袁宏，袁桷，袁樞，岳珂，顏之推，顏真卿，周煇，張九齡，張仲景，張元濟，張師正，張昱，張栻，張湛，張綱，張說，張載，張邦基，真德秀，章衡，趙孟頫，趙岐，趙明誠，趙曄，趙爽，趙秉文，鄭玄，朱慶餘，朱松，朱熹，朱震，莊廷鑨

尚未擁有維基百科條目，或者尚未建立重定向頁，或者需要改為簡體字才能鏈接至維基百科，約31%：

鮑彪，鮑山，貝瓊，陳傅浪，陳基，程端禮，程俱，敕撰，崔致遠，杜本，範坰，範浚，範梈，範攄，傅習，管時敏，桂萬榮，郭若虛，郭勛，河上公，洪邁，洪適，許渾，許月卿，華嶽，黃昇，黃仲元，吉天保，賈公顏，姜夔撰，孔安國，孔晁，李賀，李鹹用，李建勳，李劉，李元弼，劉長卿，柳貫，婁機，樓鑰，盧辯，盧文弨，盧照鄰，陸佃，陸遊，馬總，倪瓚，聶嵩義，歐陽玄，闕名，阮元撰，芮挺章，薩都刺，邵亭貞，沈與求，盛熙明，史容，史遊，史炤，釋道潛，釋道世，釋道宣，釋道原，釋法雲，釋貫休，釋寒山，釋行均，釋惠洪，釋皎然，釋齊己，釋契嵩，釋僧佑，釋玄奘，釋重顯，宋之問，蘇伯衡，蘇天爵，蘇象先，孫樵，孫星衍，王績，王俅，王惲，韋穀，韋應物，韋莊，溫庭筠，吳萊，蕭立等，謝肅，謝應芳，徐靈府，徐乾，徐鉉，楊朝英，楊炯，楊萬裏，楊雄，楊載，葉適，餘闕，元好問，元結，袁康，惲敬，章樵，張楚叔，張惠言，張籍，張九成，張君房，張耒，張孝祥，張養浩，張雨，張翥，趙崇祚，趙以夫，鄭穀，鄭思肖，周賀，朱德潤，朱彜尊

因此可以嘗試將文件鏈接至作者的維基百科

Midleading (talk) 05:55, 14 May 2017 (UTC)

维基百科简体繁体会自动转换，所以使用interwiki一般都没事。另目前状态通过维基数据连接维基百科条目与维基共享资源分类存在争议，之前有机器人专门删除此类链接，所以我不建议让维基数据链接作为唯一链接。interwiki相比保险很多 --Zhuyifei1999 (talk) 06:24, 14 May 2017 (UTC)

你觉得这个机器人现在还有什么问题需要解决的呢？需要等待一周行政员才过来授权吗？刚才那个洋人说的“Language tags”是什么，要放到哪里？还有，我这里还有大约600GB的其他扫描古籍，这些丛书大多没有整理得那么好的目录和作者信息，需要自己整理版权信息，即便是用半自动化的整理方法也需要很久，这些书籍也可以上传吗，还是需要整理以后才能上传，还是维持现状、不上传？--Midleading (talk) 07:12, 14 May 2017 (UTC)

"Language tag" 指如 {{en}}, {{zh-hant}} 子类的模板。一般而言文件说明要使用，可以参考刚评选出的2016年年度图片。其他600GB建议整理后上传，因为批量上传经常由于文件说明缺少质量引发争议（我不反对批量上传但有好几人反对）。关于授权，可能要等一阵子，这里BRFA进度慢得有时我都难受。 --Zhuyifei1999 (talk) 08:20, 14 May 2017 (UTC)

 Support with advice:

支持上传大量古籍，但是我建议您在大量上传前在维基文库发起讨论。

1. 维基共享资源是所有语言维基媒体共享的资源库，标题中应包含英文拼音。
2. 版本明确是《四部丛刊》的一大特点，建议在标题中体现。作者也应体现。版本和作者信息可以从这里找到。
3. 古籍以繁体字命名。
4. 编号非古籍本身的一部分，而是现代人所编。我觉得体现在标题里不当，可以在描述中体现。

如File:A1763：戴震东原集4-1.djvu我觉得最好命名成：File:Sibu Congkan - 戴震東原集 - 戴震 - 上海涵芬樓藏經韻樓刊本 - 1.djvu。建议对未上传的图书按此方案命名，已经上传的图书移动。--維基小霸王 (talk) 01:17, 19 May 2017 (UTC)

我认为还是要在文件名中加入编号，因为这样既便于自己管理文件也便于他人管理文件。你那个版本信息不全，我已经自己整理了版本。--Midleading (talk) 08:01, 23 May 2017 (UTC)

If possible please give a short summary of the discussion in English when finished. Thx. --Krd 15:21, 21 May 2017 (UTC)

Summary: rename existing files to new naming convention proposed in zh:s:Project:Bot policy#User:MidleadingBot, and add file descriptions and version information from database at zh:s:Special:PermanentLink/863487. New uploads are uploaded with file names and descriptions in accordance to consensus. Add interwiki links to Chinese Wikipedia pages of the author. This task is part of a project to import 430k pages to zhwikisource. A file mover at Commons is requested for service. More details about this bot is at zh:s:Project:Bot policy#User:MidleadingBot--Midleading (talk) 02:39, 25 May 2017 (UTC)