Commons:Village pump/Technical/Archive/2021/05

This is an archive of past discussions. Do not edit the contents of this page. If you wish to start a new discussion or revive an old one, please do so on the current talk page.

today's discussion about evaluation librsvg on Wikimedia

Today 15:00 (UTC) (i.e. in 4 hours) is a Discussion if Wikimedia should still use librsvg. The description can be found at phab:T283083. The discussion is held during the Hackaton an will take place in https://meet.jit.si/WMhack2021-Room1 . I hope to see you there. — Johannes Kalliauer - Talk | Contributions 10:56, 22 May 2021 (UTC)

This section was archived on a request by: — Johannes Kalliauer - Talk | Contributions 21:54, 24 May 2021 (UTC)

Only 4% of Panoramio photos made it into Commons. The rest are still on web.archive.org.

Tracked in Phabricator
Task T281629

It turns out the massive imports years ago were botched! Jidanni (talk) 00:04, 3 May 2021 (UTC)

Photos froze while uploading

I uploaded about 40 photos this evening, till the second-last phase. Then, suddenly, all froze. And I could not take this process further. If I try to upload the photos again, it's showing that I can't upload. As if the photos already exist. Could you please check and clear out the pending photos if these already exist? Thanks Fredericknoronha (talk) 19:21, 2 May 2021 (UTC) User:Fredericknoronha

You can see your own pending image uploads on Special:UploadStash. Unfinished uploads are after a set period deleted automatically (mw:Manual:$wgUploadStashMaxAge).--Snævar (talk) 11:24, 3 May 2021 (UTC)

Tech News: 2021-18

Latest tech news from the Wikimedia technical community. Please tell other users about these changes. Not all changes will affect you. Translations are available.

Recent changes

Twinkle is a gadget on English Wikipedia. It can help with maintenance and patrolling. It can now be used on other wikis. You can get Twinkle on your wiki using the twinkle-starter GitHub repository.

Problems

The content translation tool did not work for many articles for a little while. This was because of a bug. [1]
Some things will not work for about a minute on 5 May. This will happen around 06:00 UTC. This will affect the content translation tool and notifications among other things. This is because of an upgrade to avoid crashes. [2]

Changes later this week

Reference Previews will become a default feature on a number of wikis on 5 May. This is later than planned because of some changes. You can use it without using Page Previews if you want to. The earlier plan was to have the preference to use both or none. [3][4]
The new version of MediaWiki will be on test wikis and MediaWiki.org from 4 May. It will be on non-Wikipedia wikis and some Wikipedias from 5 May. It will be on all wikis from 6 May (calendar).

Future changes

The CSS classes .error, .warning and .success do not work for mobile readers if they have not been specifically defined on your wiki. From June they will not work for desktop readers. This can affect gadgets and templates. The classes can be defined in MediaWiki:Common.css or template styles instead. [5]

Tech news prepared by Tech News writers and posted by bot • Contribute • Translate • Get help • Give feedback • Subscribe or unsubscribe.

15:42, 3 May 2021 (UTC)

MediaWiki:Gadget-VisualFileChange.js became very slow today

Tracked in Phabricator
Task T282122

MediaWiki:Gadget-VisualFileChange.js became very slow today: Retrieving file-list from server. stage takes a very long time. Just in case, I use Firefox 88 on Ubuntu. --EugeneZelenko (talk) 14:34, 6 May 2021 (UTC)

@EugeneZelenko: See MediaWiki talk:Gadget-VisualFileChange.js § not loading with user's contributions as a generator and phab:T282122 AntiCompositeNumber (talk) 18:56, 6 May 2021 (UTC)

Invisible characters in image page titles

Please see w:Wikipedia:Village pump (technical)#Commons images not appearing for a discussion about this. To avoid a fork, please respond on the Wikipedia tech pump page rather than here. P. I. Ellsworth, ed. ^put'r there 17:38, 9 May 2021 (UTC)

Invisible characters in image page titles

Bad tif thumb

I want to upload many Chinese old paintings. They are in tif format. They display incorrectly. When I upload the file in png format, they display correctly. However, PNG only supports sRGB, but tif is in CMYK. When converted to png, some information would be lost. What should I do? --維基小霸王 (talk) 03:35, 10 May 2021 (UTC)

@維基小霸王: you could upload both the tif and png versions and link them with other versions -field. This way we would have the original tif preserved as well as a png version. See #No thumbnails or previews generated on tiff uploads. above for a similar problem. MKFI (talk) 06:44, 10 May 2021 (UTC)

OK. I will upload tif for archive and jpg because it's smaller.--維基小霸王 (talk) 07:55, 10 May 2021 (UTC)

Tech News: 2021-19

Latest tech news from the Wikimedia technical community. Please tell other users about these changes. Not all changes will affect you. Translations are available.

Changes later this week

The new version of MediaWiki will be on test wikis and MediaWiki.org from 11 May. It will be on non-Wikipedia wikis and some Wikipedias from 12 May. It will be on all wikis from 13 May (calendar).

Future changes

You can see what participants plan to work on at the online Wikimedia hackathon 22–23 May.

Tech news prepared by Tech News writers and posted by bot • Contribute • Translate • Get help • Give feedback • Subscribe or unsubscribe.

15:08, 10 May 2021 (UTC)

Move and merge category history of Prince Harry of Wales

Discussion moved to Commons:History merging and splitting

Hello!!
All categories with the prefix "Prince Harry of Wales" were wrongly moved to "Prince Harry" under the justifying that "he was never prince of Wales." Both Harry and William were know as "of Wales" before their respective marriages because they are sons of Charles, Prince of Wales. As examples, the same applies to Prince George of Cambridge, Princess Beatrice of York (now only Princess Beatrice), Princess Eugenie of York (now only Princess Eugenie), Princess Charlotte of Cambridge, Prince Michael of Kent.
I tried to restore the categories, however, it was not possible due to the history of each one. I ask that someone, please, to move and merge the histories of the following categories:

Minerva97 (talk) 21:15, 10 May 2021 (UTC)

Create MediaWiki:Fileimporter-cantimportfilehidden

Currently, this message displays Can't import file because at least one of its revisions contains a suppressed file. However, suppression (or oversight) specifically refers to revisions which have been hidden from the public as well as administrators, usually because they contain personally identifiable information. I think "suppressed" should be changed to "hidden" or simply "deleted". Dylsss (talk) 19:55, 8 May 2021 (UTC)

I've submitted gerrit:689061. This would then be translated on Translatewiki. — JJMC89 (T·C) 00:36, 12 May 2021 (UTC)

Thanks. Dylsss (talk) 15:14, 12 May 2021 (UTC)

SVG, HTML

SVG file is not loading. Here's a mistake "This file contains HTML or script code that may be erroneously interpreted by a web browser." Translated this file. help me please.--Takhirgeran Umar (talk) 12:57, 12 May 2021 (UTC)

Here is my file.--Takhirgeran Umar (talk) 13:47, 12 May 2021 (UTC)

File:Heart ce.svg Moved content to another file. I hope I did not spoil anything. --Takhirgeran Umar (talk) 14:31, 12 May 2021 (UTC)

Tech News: 2021-20

Latest tech news from the Wikimedia technical community. Please tell other users about these changes. Not all changes will affect you. Translations are available.

Recent changes

There is a new toolbar in the Reply tool. It works in the wikitext source mode. You can enable it in your preferences. [6] [7] [8]
Wikimedia mailing lists are being moved to Mailman 3. This is a newer version. For the character encoding to work it will change from UTF-8 to utf8mb3. [9][10]
An earlier issue of Tech News said that the citoid API would handle dates with a month but no days in a new way. This has been reverted for now. There needs to be more discussion of how it affects different wikis first. [11]

Changes later this week

MediaWiki:Pageimages-blacklist will be renamed MediaWiki:Pageimages-denylist. The list can be copied to the new name. It will happen on 19 May for some wikis and 20 May for some wikis. Most wikis don't use it. It lists images that should never be used as thumbnails for articles. [12]
The new version of MediaWiki will be on test wikis and MediaWiki.org from 18 May. It will be on non-Wikipedia wikis and some Wikipedias from 19 May. It will be on all wikis from 20 May (calendar).

Tech news prepared by Tech News writers and posted by bot • Contribute • Translate • Get help • Give feedback • Subscribe or unsubscribe.

13:47, 17 May 2021 (UTC)

MediaWiki:Gadget-Geotoolbox.js

MediaWiki:Gadget-Geotoolbox.js, also known as "Geocoding tools" in Special:Preferences, is a very simple gadget activated by 2,625 editors (298 active). It adds three links to the left sidebar toolbox: Geocoding Recent Changes Geocoding Search Geocoding Daily Log. There's only one problem: all three links are dead. I intend to remove the gadget from MediaWiki:Gadgets-definition, but figured I'd post here to make sure there were no objections. AntiCompositeNumber (talk) 22:14, 11 May 2021 (UTC)

I've blanked the gadget code, and will wait a bit longer before removing it from the gadget page. AntiCompositeNumber (talk) 02:08, 21 May 2021 (UTC)

Is there a way to search "All pages by default" in the SDC "Google-like" search engine

I really like the new search engine in a lot of ways... Unfortunately, it still has a lot of issues, among which that you can't choose to display the list of results in the old way (which is superior), or the fact that opens up images in a viewer automatically (like Ecosia, Microsoft Bing, Yahoo!, Google, DuckDuckGo, Etc.) rather than open the image in the same tab or new tab. However, the most annoying issue I have with it is that it doesn't search "All pages" by default, if I type in a category or policy page name it directs me to (usually) irrelevant images, I understand that Wikimedia Commons exists for the media but it would make more sense if "All pages" was the default.

Even for unregistered casual "visitors" this would make more sense, as they could be looking for a discriminate category rather than a more indiscriminate list of images and other files as the category is easier to navigate. --Donald Trung 『徵國單』 (No Fake News 💬) (WikiProject Numismatics 💴) (Articles 📚) 06:42, 20 May 2021 (UTC)

This search tool is called "MediaSearch" it is only made for searching for media files. For all other MediaWiki pages you need to use the old search. --GPSLeo (talk) 11:58, 20 May 2021 (UTC)

Font size decreased

Tracked in Phabricator
Task T283206

Hi, As mentioned at Commons:Village_pump#Font_size my font size has decreased dramatically, despite me going to Phab it's been marked as resolved with the person saying they can't reproduce the problem .... and nothing further has been done.
So basically it's in all in my head and doesn't exist apparently.
This issue is only affecting Commons - Font sizes on EN Wiki, Simple Wiki AND external sites all look fine .... the issue is solely with Commons ....
So can anything be done as at this point as Phab are beyond hopeless (or atleast the dealing person was!). (my settings are all fine and Chromes defult).
Thanks, –Davey2010^Talk 19:13, 20 May 2021 (UTC)

@Davey2010 does adding ?safemode=1 to the end of the URL help? AntiCompositeNumber (talk) 19:37, 20 May 2021 (UTC)

Hi AntiCompositeNumber, Apologies for the delay in getting back to you, It did! :) - When I add that the font size is normal on all pages, Thanks, –Davey2010^Talk 20:02, 20 May 2021 (UTC)

@Davey2010, alright, that means the problem is in your gadgets, User:Davey2010/common.js, or User:Davey2010/vector.css. You'll have to just start disabling things until you figure out what caused the problem. AntiCompositeNumber (talk) 20:06, 20 May 2021 (UTC)

Hi AntiCompositeNumber, Thank you so much for your help, I cleared my history and the same issue is now at EN so this does indeed look to be a problem with a gadget, Thank you so so much AntiCompositeNumber honestly cannot thank you enough, Truly appreciate your help thanks again, Take care, Warm Regards, –Davey2010^Talk 20:11, 20 May 2021 (UTC)

Hi again AntiCompositeNumber, User:Davey2010/vector.css was the culprit - I've blanked the page and then enabled "Typographyrefresh" in gadgets and the problem returned so it's something to do with the coding or atleast the font-size coding. Anyway thank you again for your help it's greatly appreciated! :), Thanks, –Davey2010^Talk 20:38, 20 May 2021 (UTC)

Resolved - Apologies for the above ranty message - Essentially got told there wasn't a problem which made me feel like I wasn't being believed, and then certain actions within the old Phab ticket occurred (such as marking the ticket as resolved when it wasn't and renaming the ticket ignoring my original complaint) which ticked me off and then I began pulling my hair out trying to out what the issue was and where it was. Phab ticket's now at https://phabricator.wikimedia.org/T283206. Thanks again AntiCompositeNumber. –Davey2010^Talk 23:17, 20 May 2021 (UTC)

Tech News: 2021-21

Latest tech news from the Wikimedia technical community. Please tell other users about these changes. Not all changes will affect you. Translations are available.

Recent changes

The Wikimedia movement has been using IRC on a network called Freenode. There have been changes around who is in control of the network. The Wikimedia IRC Group Contacts have decided to move to the new Libera Chat network instead. This is not a formal decision for the movement to move all channels but most Wikimedia IRC channels will probably leave Freenode. There is a migration guide and ongoing Wikimedia discussions about this.

Changes later this week

The new version of MediaWiki will be on test wikis and MediaWiki.org from 25 May. It will be on non-Wikipedia wikis and some Wikipedias from 26 May. It will be on all wikis from 27 May (calendar).

Tech news prepared by Tech News writers and posted by bot • Contribute • Translate • Get help • Give feedback • Subscribe or unsubscribe.

17:04, 24 May 2021 (UTC)

Files idling in a category

There is a category, where some files were originally deployed via the template. Then the template was changed to deploy files into subcategories. For some files, it was changed manually, for others via perform batch task script (PBT). Those which were fixed via PBT left the mother category, while files fixed by hand stays in the mother category still. I wonder what is the problem? Maybe some jobs on the server still haven't been done after days? --Juandev (talk) 18:01, 24 May 2021 (UTC)

@Juandev: After changing a template, pages including it may remain in categories and Special:WhatLinksHere lists for quite a long time, at least on Commons (for a template, formerly used on tens of millions of files, it took about a year to WhatLinksHere to become empty!). A workaround is null editing all files either manually, or using a bot (I chose the latter one, the category should be empty within a few minutes). —Tacsipacsi (talk) 13:04, 27 May 2021 (UTC)

User talk:Wardi 96

What is happening on this user talk page? I can't find any stray characters that would cause {{Autotranslate}} to malfunction, so why are the templates not parsed correctly? De728631 (talk) 16:33, 26 May 2021 (UTC)

Too many templates, so Mediawiki stops parsing. TommyG (talk) 16:58, 26 May 2021 (UTC)

Oh, I didn't know this limitation even exists. Thank you for clarifying. De728631 (talk) 11:01, 27 May 2021 (UTC)

Babel boxes

Hi,

Does anyone know why the level text in the Babel boxes has become bolder? (screenshot). --Thibaut (talk) 07:05, 29 May 2021 (UTC)

Apparently the bug only affects Firefox 88.0.1 and {{Babel}}, {{#babel}} works fine. --Thibaut (talk) 08:17, 29 May 2021 (UTC)

I think it depends on the font used, not the browser. (At least it also depends on the font; I didn’t see it in Firefox 89.0b15.) Anyways, it was caused by this edit, and I (hope to) have fixed it in this edit. —Tacsipacsi (talk) 10:31, 29 May 2021 (UTC)

It fixed it! Thank you. --Thibaut (talk) 11:10, 29 May 2021 (UTC)

Tech News: 2021-22

Latest tech news from the Wikimedia technical community. Please tell other users about these changes. Not all changes will affect you. Translations are available.

Problems

There was an issue on the Vector skin with the text size of categories and notices under the page title. It was fixed last Monday. [13]

Changes later this week

There is no new MediaWiki version this week.

Tech news prepared by Tech News writers and posted by bot • Contribute • Translate • Get help • Give feedback • Subscribe or unsubscribe.

17:04, 31 May 2021 (UTC)

EN language subtitles showing in EU Wikipedia

Hi, I hope I am in the right place. I actually posted a similar question some time ago with no answer. I have this video with subtitles in Basque and English.

Still when I play the video on a Basque WP page, the English subtitles appear, and actually no Basque subtitle option in Closed Caption, despite there actually being subtitles in Basque. This is a bit confusing and annoying, is there any way to automatically trigger the subtitles in the relevant language according to the WP. On another WP article, no subtitles appear at all, and CC options go "no text tracks available". Iñaki LL (talk) 20:56, 28 May 2021 (UTC)

Actually, it seems to take some time until the the right subtitles trigger, but they do trigger! So for the time being, this seems to be solved. Iñaki LL (talk) 18:58, 2 June 2021 (UTC)

Create a tag for User:Jack who built the house/Convenient Discussions

Hi, more and more users are using this script, and I would like to move the tag from the edit description to the correct place. You can see what I talking about here. Can you create, please? :)
MediaWiki:Tag-convenient-discussions -> [[Special:MyLanguage/User:Jack who built the house/Convenient Discussions|CD]]
MediaWiki:Tag-convenient-discussions-description -> Edit made using [[Special:MyLanguage/User:Jack who built the house/Convenient Discussions|Convenient Discussions]]. Iniquity (talk) 17:46, 13 May 2021 (UTC) Iniquity (talk) 17:52, 13 May 2021 (UTC)

No objections for nearly a month, I have created tags rubin16 (talk) 11:06, 5 June 2021 (UTC)

Did I observe correctly that CropTool writes sth like "new uploaded, derivated file of the present one" into source files, but DerivativeFX doesn't [SOLVED]

Example: File:Bose Acoustic Wave Music System 3000 CD&Radio (cropped).jpeg was created as new file with CropTool, and the source file has got a nice little thumb at "other version" together with the text "This file has an extracted image: [Filename]". In comparison, this file File:Bahnhof München-Pasing, 2012 (cropped).jpg was uploaded with DerivativeFX, but the source file File:Bahnhof München-Pasing, 2012.jpg was not altered at all, hence it has no hint to the derivative work, which I find improvable. I reproduced the above with some files and did get same result. Pittigrilli (talk) 20:30, 17 May 2021 (UTC)

My above question/remark is now 10 days old, without any response. Given the un-questionable significance of the adressed subject, I find this a bit strange. Either my observation is something which is intended, then a "no problem" as an answer would not have been difficult. If I found sth. which is improvable, an "oh thanks for pointing this out" would have made sense. Pittigrilli (talk) 23:00, 26 May 2021 (UTC)

I found out that the error I saw is/was real - However, this seems to have occurred only for some files in a row (see above) some weeks ago. Now, also DerivativeFX automatically inserts a label "This file has derivative works" in the source files for me. Pittigrilli (talk) 09:13, 5 June 2021 (UTC)

Large tif upload from China

I want to upload many tif files of ancient Chinese paintings up tp 3 GB. While I can upload jpg files and smaller tif files without trouble, big tif files fails. Is there a way to do it? --維基小霸王 (talk) 14:36, 12 May 2021 (UTC)

You're probably looking for Help:Chunked upload. TommyG (talk) 17:31, 12 May 2021 (UTC)

@維基小霸王: There are known issues with uploads larger than 100MB. See this thread. You may need to request a Server-side upload for these. Xover (talk) 22:12, 12 May 2021 (UTC)

OK.--維基小霸王 (talk) 04:29, 13 May 2021 (UTC)

@維基小霸王: I looked at your files and find them to be extremely beautiful and important works (which is kind of logical regarding the subject). I would highly recommend that you add at least minimal information on each item in English (such as date, depicted object and artist), which is now hardly existent. This would make the files much more useful, as people will hardly include them in Wikipedia articles without having information thereon. Remember, there are almost only amateurs around here. Greetings, Pittigrilli (talk) 23:16, 17 May 2021 (UTC)

However, there is a huge amount of them so I can't do it for all... I will try to use wikidata item as author in future uploads.

I have problem in uploading big tifs. I need help. An experienced user has agreed to help but I don't know if it will work. If it doesn't work, I will ask here...--維基小霸王 (talk) 00:44, 18 May 2021 (UTC)

@維基小霸王: If it doesn't work out with the other experienced user, I will try to help you. In that case, I will need access to the files to download to my side and a list of the metadata. Inductiveload (talk) 18:31, 19 May 2021 (UTC)

@Inductiveload: Great! Have you tried uploading big files up to 3 GB?--維基小霸王 (talk) 04:01, 20 May 2021 (UTC)

@維基小霸王: I'll be using Pywikibot in async chunked mode, which has certainly done > 1GB for me before. If you can point me to an example file, I'll give it a try and see how it goes. Inductiveload (talk) 04:20, 20 May 2021 (UTC)

@Inductiveload: Thanks. But baidu wangpan, the net drive I use, requires an paid account for fast downloading big files. I will set up one for you. It may take a bit time.--維基小霸王 (talk) 01:23, 23 May 2021 (UTC)

@維基小霸王: any progress on this? If you're struggling, another alternative might be to create a .torrent file and I can torrent them directly from you? Otherwise, if you can get access to Dropbox, I can give you a shared folder to upload to. You can email me with any private links.

In the meantime, I will also need the files' metadata to make the file descriptions. Inductiveload (talk) 08:30, 28 May 2021 (UTC)

@Inductiveload: I have sent you an email for download instructions. --維基小霸王 (talk) 13:24, 29 May 2021 (UTC)

@維基小霸王: OK, so I have downloaded the demo file and tried to upload it (twice). While I can upload all the chunks now, the process still dies after several minutes of re-assembly with

stashfailed: Could not store upload in the stash (UploadStashFileException): "An unknown error occurred in storage backend "local-swift-codfw".".

I guess we might really be looking at a server-side upload. Inductiveload (talk) 22:15, 10 June 2021 (UTC)

Thanks for trying! Can you tell me your downloading speed from Baidu Wangpan? --維基小霸王 (talk) 22:19, 10 June 2021 (UTC)

@維基小霸王: Looks pretty good: ~10MBps at the moment.

I started to upload some of the "Tianjin" files to the IA: https://archive.org/details/17_20210610_20210610_1808 (might be easier to hand them over for server-side upload that way). However, uploading to the IA is incredibly slow. I also don't have a filename -> info mapping, so I haven't been able to construct metadata for testing small file uploaded (possibly the smaller files are possible to upload). Inductiveload (talk) 01:21, 11 June 2021 (UTC)

May be we could reorganize the files before uploading?There are actually duplicated files.--維基小霸王 (talk) 08:00, 11 June 2021 (UTC)

@維基小霸王: Sure, all I need is a mapping from filename to metadata (artist, title, page number/side, that kind of thing). A spreadsheet will work, for example. 15:36, 11 June 2021 (UTC)

I will require a lot of work. I will tell you if it's ready.維基小霸王 (talk) 07:05, 18 June 2021 (UTC)

@維基小霸王 and Inductiveload: Are you making progress on this? There have been some infrastructure changes that should partially alleviate the problems with large uploads, so some previously failed uploads may now succeed. And there is always the option of requesting server-side uploads, cf. the thread below. --Xover (talk) 08:41, 6 July 2021 (UTC)

@Midleading: Does it solve the large PDF upload issue?--維基小霸王 (talk) 06:47, 7 July 2021 (UTC)

Just retried one of the 1GB file, and the server throws

<?xml version="1.0"?><api servedby="mw2308"><error code="internal_api_error_DBQueryError" info="[c937a5fa-bdcb-4fe3-93f6-82f358b045df] Caught exception of type Wikimedia\Rdbms\DBQueryError" errorclass="Wikimedia\Rdbms\DBQueryError" /></api>

at me. --Midleading (talk) 04:03, 11 July 2021 (UTC)

Retried twice from the upload stash, the first time I was greeted by

<?xml version="1.0"?><api servedby="mw2320"><error code="stashfailed" info="Could not read file "mwstore://local-swift-codfw/local-temp/a/ad/18gzwiwmdjg8.ugf3hz.6539091.pdf.0"." xml:space="preserve">See https://commons.wikimedia.org/w/api.php for API usage. Subscribe to the mediawiki-api-announce mailing list at &lt;https://lists.wikimedia.org/mailman/listinfo/mediawiki-api-announce&gt; for notice of API deprecations and breaking changes.</error></api>

. The second time no errors occurred, but the file created is broken with just 1 block of data.--Midleading (talk) 04:11, 11 July 2021 (UTC)

@Midleading / @維基小霸王: Yeah, aiui, that's the DB call crapping out with a timeout, essentially (the returned errors are generic and come from higher-level code). If you still can't sneak it in there during a slow period I think requesting a server-side upload is your only realistic option. Xover (talk) 08:56, 11 July 2021 (UTC)