Commons:Bots/Requests

Shortcut: COM:BRFA

If you want to run a bot on Commons, you must get permission first. To do so, file a request following the instructions below.

Please read Commons:Bots before making a request for bot permission.

I	Create a user account (while logged in to your normal account) and user page for the bot On the bot's userpage, add {{Bot}}, which automatically adds the page to Category:Commons bots. Then add the following information to the bot's userpage (all this is mandatory): Operator: Who the creator/operator is and how they can best be contacted Tasks: Details of the bot's task or tasks Operation: Whether the bot is manually assisted or runs automatically When: When it operates (continuously, intermittently, or at specified intervals) Maximum edit rate: The bot's maximum edit rate (eg edits per minute) Language: The language and/or program that it is running
II	Create your bot request: Replace "YourBotName" with your bot's username in the box below and click the button. Complete the questions on the resulting page and save it. Remember that your bot will be allowed to operate only for those tasks that you have specified in your request. Add your bot request to the list here: Edit the following request list, adding the following text to the top of the appropriate section (replacing "YourBotName" with your bot's name): {{Commons:Bots/Requests/YourBotName}}
III	Test run Make a short test run with your bot account (30-50 edits/uploads) to allow other users to review your bot's tasks.
IV	Waiting for approval. You now need to wait for community approval. A bureaucrat will close the request and will also grant a bot flag, where necessary. Closed requests are moved to Commons:Bots/Archive.

Archives List all Requests Requests by closing date

Requests made on this page are automatically transcluded in Commons:Requests and votes for wider comment.

Requests for permission to run a bot

watch

Before making a bot request, please read the new version of the Commons:Bots page. Read Commons:Bots#Information on bots and make sure you have added the required details to the bot's page. A good example can be found here.

When complete, pages listed here should be archived to Commons:Bots/Archive.

Any user may comment on the merits of the request to run a bot. Please give reasons, as that makes it easier for the closing bureaucrat. Read Commons:Bots before commenting.

GODLBot (talk · contribs)

Operator: Eatcha (talk · contributions · Number of edits · recent activity · block log · User rights log · uploads · Global account information)

Bot's tasks for which permission is being sought:

• Review Unreviewed photos of GODL-India must have an URL to match images.
• Sometimes our manual reviewers don't remove the Unreviewed photos of GODL-India, after reviewing. This bot should fix these too.
• If the original file passes review/already revied, it should review the cropped file too(Uses Vision for verification).
• Leave an edit summary "passed review - godl"
• If can't find the image in the website, will not do anything
• GOI's sites are *.gov.in or *.nic.in (I blacklisted postagestamps.gov.in, a user told me that it's not sure if stamps are covered by GODL license )

Automatic or manually assisted: Fully Automatic, can run manually too.

Edit type (e.g. Continuous, daily, one time run): Continuous until every possible image is reviewed.

Maximum edit rate (e.g. edits per minute): Depends on GOI's servers, google's cloud services and our servers too. I'm using my own API key for this job, it depends on my usage. I use Vision for my IRL projects. If my users use up(highly unlikely but ...) the limit that I'm paying for, then it(the BOT) will run from the next possible month. NOTE: usually GOI's servers are turtles, super slow.

Bot flag requested: (Y/N): Yes

Programming language(s):Python(Pywikibot)

Discussion

I don't have LR rights, do I need to apply for it? If yes, I will not review anything manually just have it for formality. Already 95 test edits made all successful. Best, Eatcha (talk) 20:46, 28 July 2019 (UTC)

I think it's OK to make review without rights as long as test runs are small. 5-10 are enough to test bot functionality. --EugeneZelenko (talk) 13:43, 29 July 2019 (UTC)

I actually rollbacked all of these test edits, there are users who can file deletion requests with arguments like "Fake review, the bot was not flagged or had LR rights at the time of review." And GOI's administrators remove/replace images, the worst part of this GODL backlog. -- Best, Eatcha (talk) 04:30, 30 July 2019 (UTC)

It was definitely too huge test run. You could refer to this request in edit summary to reduce misunderstandings.

Please make test run for files originated from different web sites.

EugeneZelenko (talk) 14:25, 30 July 2019 (UTC)

Here's a list of sites that are tested, I will add more to the list until it's enough

• www.indiannavy.nic.in
• indianarmy.nic.in
• www.isro.gov.in
• indianairforce.nic.in
• eci.gov.in
• pib.nic.in
• pibcms.nic.in
• www.indiancoastguard.gov.in
• www.spl.gov.in

-- Eatcha (talk) 17:47, 30 July 2019 (UTC)

• edistrict.delhigovt.nic.in
• www.pmindia.gov.in
• www.mea.gov.in
• mha.gov.in
• uidai.gov.in
• www.delhipolice.nic.in
• morth.nic.in
• tourism.gov.in
• apeda.gov.in
• www.indiaculture.nic.in
• www.nic.in
• nationalmuseumindia.gov.in
• www.civilaviation.gov.in

EugeneZelenko Do I need to do more ? I uploaded these images from diffrent sites to test it .-- 15:45, 31 July 2019 (UTC)

Looks OK for me. However there are confusions over term of use, so it'll be good idea if Wikimedia India will work with government sites to update their terms of use. --EugeneZelenko (talk) 14:34, 1 August 2019 (UTC)

Can we close this till it's resolved ? It should take some time IMHO. Best, Eatcha (talk) 20:30, 1 August 2019 (UTC)

May be bot could work for sites win non-controversial term of uses now? Later list of such sites could be expanded. --EugeneZelenko (talk) 13:55, 2 August 2019 (UTC)

How does your bot function? User:Tiven2240 found a problem. How did it pass File:C. Achutha Menon.jpg when the source given were two links to html pages and this photo matches none of the photos on those two webpages (because this is actually a crop of one of the photos)? Some kind of computer vision at work?--Roy17 (talk) 16:39, 3 August 2019 (UTC)

@Eatcha: ? --Krd 08:06, 1 September 2019 (UTC)

There are also Twitter accounts of various parts of government of India. See Vaibhavafro (talk · contribs) uploads as example. --EugeneZelenko (talk) 14:27, 5 September 2019 (UTC)

@EugeneZelenko:Yes, and these twitter accounts function much in the same way as the Press Information Bureau. Some points here:(1)These accounts are used to distribute visuals to Indian media houses(2)Indian media houses use these visuals under the same GODL License(3)So, I am pretty sure Commons can also use these.Vaibhavafro (talk) 23:45, 5 September 2019 (UTC)

• @Eatcha: Would you like to address issues raised above? --Krd 15:19, 13 September 2019 (UTC)

FerdiBot (talk · contribs)

Operator: Ferdi2005 (talk · contributions · Number of edits · recent activity · block log · User rights log · uploads · Global account information)

Task: it will do a SPARQL query, looking for Wiki Loves Monuments Italy monuments without a category. Then, it’ll search here for photo submitted with that monument’s WLM ID. If it founds one, it’ll create a category and append to that photos the category it has just created. Then it adds the category to wikidata with the property Commons category.

You can find the source code here. Automatic or manually assisted: manually assisted

Edit type (e.g. Continuous, daily, one time run): runs every time the script is launched, once every month

Maximum edit rate (e.g. edits per minute): once every 15 seconda

Bot flag requested: (Y/N): N

Programming language(s): PHP using boz-mw framework. Ferdi2005 _(Posta) 07:52, 19 July 2019 (UTC)

Discussion

• please, consider as bot edits only the edits done after the creation of this request, because the script is running now. Before I was just using bot account only semi-automatically.--Ferdi2005 _(Posta) 08:00, 19 July 2019 (UTC)

  I can't successfully do test edits because of a captcha! (Because the bot is not autoconfirmed). I'll redo test edits when the bot will be autoconfirmed, please mantain this request on hold until that.--Ferdi2005 _(Posta) 13:44, 19 July 2019 (UTC)

  Bot account has confirmed status now. Please make new test run, because older directories were often redirected to existing ones, so probably you need to check Commons categories without Wikidata manually first. Also newly created directories often are not categorized themselves. --EugeneZelenko (talk) 14:13, 19 July 2019 (UTC)

  @EugeneZelenko: See this as an example Category:Temple of Venus in Pompeii. If we need, the bot automatically add town's category as parent category. What do you think about this?

  — Preceding unsigned comment added by Ferdi2005 (talk • contribs) 18:23, 19 July 2019‎ (UTC)

  Please take a look on File:MADONNA TRA SAN ROCCO e BEATA PANACEA.JPG. File was over-categorized already and Category:Chiesa di San Rocco is clear duplicate of Category:San Rocco (Ghemme). Looks like list of needed categories for bot must be created manually. --EugeneZelenko (talk) 15:12, 20 July 2019 (UTC)

  But that wasn't in Wikidata. I added that there is a manual confirmation before creation of the category and about the title and it adds automatically city's category in the category. What do you think about this? @EugeneZelenko:--Ferdi2005 _(Posta) 18:20, 20 July 2019 (UTC)

  This is exactly my point: some Commons categories may be not connected to Wikidata items yet. It's good idea to check both Wikidata/Commons before creating categories. May be special project should be organized to distribute task across users. --EugeneZelenko (talk) 18:24, 20 July 2019 (UTC)

  @EugeneZelenko: Now, the script looks up for categories with similar names, so if there's a category yet, the user (now it's manual) can abort.--Ferdi2005 _(Posta) 19:43, 22 July 2019 (UTC)

  Could you please run only matching part of code without creating/changing categories and add link to results here? Just to see how well algorithm works. --EugeneZelenko (talk) 14:47, 23 July 2019 (UTC)

  @EugeneZelenko: You can find the code itself at this github repo. Script running:

[2019-07-29 21:15:10][INFO] login with username 'FerdiBot'
Inizializzzo connessione con usernameFerdiBot</br>  # Initializing connection with username FerdiBot
Esecuzione della query SPAQRL # executing SPARQL query
	SELECT ?item ?itemLabel ?value ?city ?cityLabel ?sitelink ?coords ?citycat WHERE {
	?item wdt:P2186 ?value.
	?item wdt:P17 wd:Q38.
	?city wdt:P373 ?citycat
	FILTER NOT EXISTS { ?item wdt:P373 ?x. }
	FILTER NOT EXISTS { ?item wdt:P935 ?y. }
	SERVICE wikibase:label { bd:serviceParam wikibase:language "[AUTO_LANGUAGE], en, it". }
	?item wdt:P131 ?city.
	OPTIONAL { ?item wdt:P625 ?coords.}
	?city wdt:P373 ?citycat
	OPTIONAL {?sitelink schema:isPartOf <https://commons.wikimedia.org/>;schema:about ?item. }
	}
	LIMIT 500</div> <br/> <ol><li> Eseguo operazioni sul monumento [http://www.wikidata.org/entity/Q2391849] complesso nuragico di Tamuli (Q2391849) </a> </br> #Executing operations on the monument
Cerco foto che abbiano il WLMID di quel monumento salvato #looking for photos with that WLMID
Non abbiamo trovato categorie simili.Vuoi che il nome della categoria sia complesso nuragico di Tamuli? Rispondi Y se sì oppure scrivi il nome che la categoria deve avere. Scrivi abort per stoppare ed andare avanti." # We didn't find similar categories. Do you want "complesso nuragico di Tamuli" as category name? Reply Y if yes or write the name the category should have. Write abort to stop and go to the next monument

string with # are my translations from english--Ferdi2005 _(Posta) 21:19, 29 July 2019 (UTC)

Could you please create report in wiki-text, so participants of this discussion could analyze it? --EugeneZelenko (talk) 14:28, 30 July 2019 (UTC)

@EugeneZelenko: What do you mean for report in Wikitext?--Ferdi2005 _(Posta) 19:40, 30 July 2019 (UTC)

I meant table with links to Wikidata item, possible match and place category when no match found published in your or bot user space. --EugeneZelenko (talk) 13:52, 31 July 2019 (UTC)

So, you propose to have the bot writing the created categories on a page? An interesting solution would be create manually assisted categories (manual name and printing of similar name categories) and then add to created categories the "To check - WLMIT" category, so I or another volunteer can check the created categories and see if there's any problem. What do you think about this? @EugeneZelenko:--Ferdi2005 _(Posta) 19:31, 7 August 2019 (UTC)

Goal of this test is to check how well bot detects existed categories not linked to Wikidata. There is no need to create new ones at that stage. --EugeneZelenko (talk) 14:10, 8 August 2019 (UTC)

• Please put new categories in a new line, as per the standard on commons, see this edit --Schlurcher (talk) 11:53, 13 August 2019 (UTC)
• The bot generates orphan categories (without any connection to the category tree) like this: [1]. Likewise concerning is that there is already an existing category: Category:Steppe Sarde --Schlurcher (talk) 11:53, 13 August 2019 (UTC)
• @Ferdi2005: ? --Krd 08:01, 1 September 2019 (UTC)

  @Ferdi2005: Final call. --Krd 15:20, 13 September 2019 (UTC)

• I modified the bot to be semi-automatic and operated by an human, it adds automatically the category of the city if there's one. @Schlurcher: I will apply your suggestions, if there's consensus about the opportunity to have this bot.--Ferdi2005_[Mail]

  Could you please provide results of existing categories detection functionality testing? --EugeneZelenko (talk) 13:55, 14 September 2019 (UTC)