Wikimedia Commons

Commons:Wiki Loves Classics 2019/selection

< Commons:Wiki Loves Classics 2019

Selection process for Wiki Loves Classics 2019

Preparation of categories edit

Revision of categories edit

Country General list of monuments All files uploaded Wiki Loves Classics files General check Revision
  Albania List of monuments Uploaded files WLC files   Doing… User:Alexmar983
  Done --Epìdosis 14:43, 31 October 2019 (UTC) P.S. I removed three images of this bridge, which seems not to be a Roman bridge[reply]
 No idea why the images of the bridge were inserted. I remember I checked it and I know it's not Roman.--Alexmar983 (talk) 01:03, 1 November 2019 (UTC)[reply]
  Armenia List of monuments Uploaded files WLC files   Done all the images of Garni Temple; I'm not able to select images of other ancient Armenian sites, especially because I don't know Armenian language. --Epìdosis 16:22, 31 October 2019 (UTC)[reply]   Doing…--Alexmar983 (talk) 16:43, 15 November 2019 (UTC)   Done added the Petroglyphs from Ukhtasar , but I have to skip some artifacts of the Sisian History Museum, not enough information.--Alexmar983 (talk) 14:51, 24 November 2019 (UTC) added d:Q2479712[reply]
  Algeria List of monuments Uploaded files WLC files I might have taken an uncertain approach with some ancient burial sites--Alexmar983 (talk) 00:42, 14 October 2019 (UTC)[reply]
  Done Burial sites seem correct; I've found some more photos. Maybe a last control would help. --Epìdosis 17:16, 17 October 2019 (UTC)[reply]
   Done--Alexmar983 (talk) 22:52, 5 November 2019 (UTC)[reply]
  Austria List of monuments Uploaded files WLC files Seemingly nothing. --Epìdosis 20:23, 2 October 2019 (UTC)[reply]   Doing… Alexmar983   Done--Alexmar983 (talk) 23:55, 16 November 2019 (UTC)[reply]
  Croatia List of monuments Uploaded files WLC files   Done --Epìdosis 21:26, 3 October 2019 (UTC)[reply] Verified--Alexmar983 (talk) 11:32, 3 November 2019 (UTC)[reply]
  France List of monuments Uploaded files WLC files   Done I may have missed some. --Epìdosis 15:43, 31 October 2019 (UTC)[reply]   Doing…--Alexmar983 (talk) 20:46, 17 November 2019 (UTC)  Done--Alexmar983 (talk) 14:52, 24 November 2019 (UTC)[reply]
  Germany List of monuments Uploaded files WLC files DE-BB   Done--Alexmar983 (talk) 00:47, 16 October 2019 (UTC)[reply]

DE-BE   Done one image in a museum--Alexmar983 (talk) 20:02, 22 October 2019 (UTC)[reply]
DE-BE   Doing… --Alexmar983 (talk) 20:02, 22 October 2019 (UTC)[reply]
DE-HB   Done--Alexmar983 (talk) 23:36, 15 October 2019 (UTC)[reply]
DE-MV   Doing…--Alexmar983 (talk) 23:36, 15 October 2019 (UTC)[reply]

  Done all. --Epìdosis 12:29, 24 October 2019 (UTC)[reply]
 DE-BB   Done--Alexmar983 (talk) 20:43, 2 November 2019 (UTC)[reply]

DE-BE   Done--Alexmar983 (talk) 12:52, 10 November 2019 (UTC)[reply]
DE-BW   Done--Alexmar983 (talk) 00:18, 11 November 2019 (UTC)[reply]
DE-BY   Done--Alexmar983 (talk) 22:18, 18 November 2019 (UTC)[reply]
DE-HE   Done--Alexmar983 (talk) 21:26, 17 November 2019 (UTC)[reply]
DE-HB   Done--Alexmar983 (talk) 00:04, 17 November 2019 (UTC)[reply]
DE-HH   Done--Alexmar983 (talk) 02:52, 15 November 2019 (UTC)[reply]
DE-MV   Done--Alexmar983 (talk) 15:07, 12 November 2019 (UTC)[reply]
DE-NI   Done--Alexmar983 (talk) 22:45, 5 November 2019 (UTC)[reply]
DE-NW   Done--Alexmar983 (talk) 15:23, 17 November 2019 (UTC)[reply]
DE-RP   Done--Alexmar983 (talk) 00:09, 17 November 2019 (UTC)[reply]
DE-SH   Done--Alexmar983 (talk) 02:47, 15 November 2019 (UTC)[reply]
DE-SL   Done--Alexmar983 (talk) 19:40, 9 November 2019 (UTC)[reply]
DE-SN   Done--Alexmar983 (talk) 19:12, 11 November 2019 (UTC)[reply]
DE-ST   Done--Alexmar983 (talk) 19:53, 13 November 2019 (UTC)[reply]
DE-TH   Done--Alexmar983 (talk) 15:24, 12 November 2019 (UTC)[reply]

  Greece Lists of monuments Uploaded files WLC files   Done I've included paleochristian churches till the 5th century AD. --Epìdosis 17:18, 31 October 2019 (UTC)[reply]   Done --Geraki TLG 13:34, 11 November 2019 (UTC)[reply]
  Ireland List of monuments Uploaded files WLC files   Done --Epìdosis 14:07, 10 November 2019 (UTC)[reply]   Doing…--Alexmar983 (talk) 19:15, 16 November 2019 (UTC)  Done--Alexmar983 (talk) 16:47, 17 November 2019 (UTC)[reply]
  Italy List of monuments Uploaded files WLC files   Done --Epìdosis 20:43, 5 November 2019 (UTC)[reply] Abruzzo   Done--Alexmar983 (talk) 15:50, 13 November 2019 (UTC)[reply]

Aosta Valley   Done--Alexmar983 (talk) 15:50, 13 November 2019 (UTC)[reply]
Apulia   Done Missing the Anfiteatro of Lecce and d:Q3683551--Alexmar983 (talk) 01:34, 24 November 2019 (UTC)[reply]
Basilicata   Done d:Q1058770 was missing, also two images of Telamone di Montescaglioso --Alexmar983 (talk) 01:09, 24 November 2019 (UTC)[reply]
Campania   Done--Alexmar983 (talk) 00:18, 17 November 2019 (UTC)[reply]
Emilia-Romagna   Done--Alexmar983 (talk) 19:16, 22 November 2019 (UTC) Friuli-Venezia Giulia   Done, d:Q752696 partially missing.--Alexmar983 (talk) 17:19, 17 November 2019 (UTC)[reply]
Lazio  Done Some bridges have an ancient origin they could be included--Alexmar983 (talk) 17:18, 23 November 2019 (UTC)[reply]
Liguria   Done--Alexmar983 (talk) 00:09, 19 November 2019 (UTC)[reply]
Lombardy   Done--Alexmar983 (talk) 12:36, 20 November 2019 (UTC)[reply]
Marche   Done--Alexmar983 (talk) 00:15, 23 November 2019 (UTC)[reply]
Molise   Done--Alexmar983 (talk) 00:55, 19 November 2019 (UTC)[reply]
Piedmont   Done--Alexmar983 (talk) 00:30, 24 November 2019 (UTC)[reply]
Sardinia   Done--Alexmar983 (talk) 22:18, 17 November 2019 (UTC)[reply]
Sicily   Done--Alexmar983 (talk) 12:19, 19 November 2019 (UTC)[reply]
Trentino-Alto Adige   Done --Alexmar983 (talk) 01:19, 24 November 2019 (UTC)[reply]
Tuscany   Done--Alexmar983 (talk) 17:46, 17 November 2019 (UTC)[reply]
Umbria  Done--Alexmar983 (talk) 00:55, 19 November 2019 (UTC)[reply]
Veneto  Done some images of the Arena in Verona --Alexmar983 (talk) 01:19, 24 November 2019 (UTC)[reply]

  Kosovo List of monuments Uploaded files WLC files Seemingly nothing (or maybe we can include just this). --Epìdosis 20:42, 1 October 2019 (UTC)[reply] it's better than deleting the category, I put it there, verified few other images just to be sure.--Alexmar983 (talk) 22:01, 1 October 2019 (UTC)[reply]
  Malta List of monuments Uploaded files WLC files Seemingly nothing. --Epìdosis 20:42, 1 October 2019 (UTC)[reply] I confirm, I partially checked the list before the competition started and aparentyl there was no site related to our topics--Alexmar983 (talk) 22:05, 1 October 2019 (UTC)[reply]
  Morocco List of monuments Uploaded files WLC files   Done --Epìdosis 20:43, 2 October 2019 (UTC)[reply]   Done --Alexmar983 (talk) 22:46, 5 November 2019 (UTC)[reply]
  Portugal List of monuments Uploaded files WLC files DarwIn
  Done --Epìdosis 18:14, 31 October 2019 (UTC) P.S. Sometimes I've noticed Category:Cultural heritage monuments in Roman Empire with known IDs, it should be avoided by editing the template in some way[reply]
   Done some images of Roman bridge were missing.--Alexmar983 (talk) 20:20, 7 November 2019 (UTC)[reply]
  Romania List of monuments Uploaded files WLC files So far, nothing.--Alexmar983 (talk) 16:06, 17 October 2019 (UTC)[reply]
  Done Plenty of images; please check if I've missed some. --Epìdosis 16:53, 17 October 2019 (UTC)[reply]
   Doing… added d:Q6542263--Alexmar983 (talk) 00:28, 10 November 2019 (UTC)[reply]
  Done--Alexmar983 (talk) 21:58, 11 November 2019 (UTC)[reply]
  Slovenia List of monuments Uploaded files WLC files Seemingly nothing. --Epìdosis 20:47, 2 October 2019 (UTC)[reply] I confirm--Alexmar983 (talk) 22:14, 5 October 2019 (UTC)[reply]
  Spain List of monuments Uploaded files WLC files   Done --Epìdosis 19:13, 2 October 2019 (UTC)[reply]   Doing…--Alexmar983 (talk) 20:23, 7 November 2019 (UTC)   Done--Alexmar983 (talk) 21:49, 18 November 2019 (UTC)[reply]
  Switzerland List of monuments Uploaded files WLC files   Done --Epìdosis 22:00, 13 October 2019 (UTC)[reply]   Done--Alexmar983 (talk) 19:52, 8 November 2019 (UTC)[reply]
  Ukraine List of monuments Uploaded files WLC files   Done, although I may have missed some (among more than 30k files!) --Epìdosis 23:35, 5 November 2019 (UTC)[reply]   Doing…--Alexmar983 (talk) 17:14, 17 November 2019 (UTC)  Done--Alexmar983 (talk) 01:38, 24 November 2019 (UTC)[reply]
  United Kingdom List of monuments Uploaded files WLC files   Done --Epìdosis 20:07, 2 October 2019 (UTC)[reply]   Done Northern Ireland--Alexmar983 (talk) 19:41, 9 November 2019 (UTC)[reply]

  Doing… Scotland--Alexmar983 (talk) 19:41, 9 November 2019 (UTC)   Done d:Q923324 added--Alexmar983 (talk) 23:01, 11 November 2019 (UTC)[reply]
  Doing… England--Alexmar983 (talk) 23:02, 11 November 2019 (UTC)   Done I put also the 5 images of Bronze Age bowl barrows on Petersfield Heath--Alexmar983 (talk) 21:56, 13 November 2019 (UTC)[reply]
  Doing… Wales --Alexmar983 (talk) 01:32, 12 November 2019 (UTC)   Done--Alexmar983 (talk) 19:52, 17 November 2019 (UTC)[reply]

--Epìdosis 19:00, 30 September 2019 (UTC)[reply]

I think we can sign when we have completed one passage (as above). --Epìdosis 20:46, 1 October 2019 (UTC)[reply]

Spain edit

  • Uncertain about some photos of d:Q250523, because the central part of the bridge is not Roman (only the arch at one end is Roman); in my opinion the photos depicting only the central part should not be included. --Epìdosis 21:13, 1 October 2019 (UTC)[reply]
We can keep them, at least for now. --Epìdosis 21:26, 3 October 2019 (UTC)[reply]
  Done added. --Epìdosis 21:26, 3 October 2019 (UTC)[reply]
User:Epìdosis we are including all "mixed" artifacts and buildings (maybe with a special mention "best mixture of old and new") and all ancient civilizations. The general idea is to be tolerant in order to experiment, it's actually complex to draw a line in may cases and it requires an expertise we sometimes don't even have yet. In case of doubt, let's keep. We can make a final decision at the end of the selection, eventually.--Alexmar983 (talk) 21:10, 3 October 2019 (UTC)[reply]
@Alexmar983: I've already reported it on the 1st of October ;-) I think I've selected only files containing ancient remains, so it's probably OK. --Epìdosis 08:19, 24 November 2019 (UTC)[reply]

Ukraine edit

hello there! i think we missed (somehow) the information about this contest... we can populate the category, but we need a bit more time. can you please tell me the deadline? --アンタナナ 21:38, 4 October 2019 (UTC)[reply]

アンタナナ this is an experiment, so don't worry. We informed as many national competitions as possible and we actually missed you originally in the plan, so we inserted you few days ago. There is no rigid deadline. We were going to populate the category ourselves but you can do it as well, we will revise it. But take it easy, i repeat, it's a general test, the plan is next year to do things in advance. ok? All the jurors are informed we will need them for a much better event next year, for example. Would you like to suggest a juror for 2019 (and 2020). please let us know. Also, please tell interested uk-N user to enroll on meta: m:WikiClassics User Group.--Alexmar983 (talk) 22:25, 4 October 2019 (UTC)[reply]
アンタナナ   Done I've just finished to select all the images related to the contest, although I may have missed some, because of the high number of images and of my inexistent knowledge of Ukrainian language. Good night, --Epìdosis 23:37, 5 November 2019 (UTC)[reply]

Switzerland edit

We forgot Switzerland, I spoke to them in the afternoon, they entered WLM last minute. there is not a lot of things, I put for the moment the exterior of a museum and a bridge that was reconstructed on an old Roman bridge (since we discussed about a category for "mixture of old and new"), but it was worth to look there. I will put it in the table here soon.--Alexmar983 (talk) 22:31, 4 October 2019 (UTC)[reply]

@Alexmar983: It's OK, I added Switzerland in the table and I've found also some other monuments. I agree about the exterior of the museum, while I think that the bridge, being totally reconstructed (I think there is no Roman material at all), can not be considered a "mixture of old and new" and should therefore be removed. Bye, --Epìdosis 22:00, 13 October 2019 (UTC)[reply]
User:Epìdosis ok.--Alexmar983 (talk) 22:26, 13 October 2019 (UTC)[reply]
  Done. --Epìdosis 23:37, 5 November 2019 (UTC)[reply]

Germany edit

d:Q34561254 (Zwölf Apostel (Langenbach)) could also be vorgeschichtlich as de.wikipedia states. Should we keep these images just in case?--Alexmar983 (talk) 17:14, 17 November 2019 (UTC)[reply]

@Alexmar983: I would keep it. --Epìdosis 18:38, 18 November 2019 (UTC)[reply]
ok, good. I can complete BY and therefore Germany.--Alexmar983 (talk) 18:55, 18 November 2019 (UTC)[reply]

All done edit

All   Done, finally Category:Images from Wiki Loves Classics 2019 contains 3229 images. Thanks to Alexmar983, DarwIn and Geraki for the great job! Tomorrow we start with the first round. --Epìdosis 15:36, 24 November 2019 (UTC)[reply]

Actually is this evening... but fine. I add here 90 more petrogliphs so the total is 3320.--Alexmar983 (talk) 15:38, 24 November 2019 (UTC)[reply]

Other categories edit

As I did with Category:Images from Wiki Science Competition 2017 we should create specific categories for valued, quality and featured images.

Waiting for the parallel sorting I think we can insert a gallery with those and monitor them (revising the categories, we will find them), it should give an idea of the level of possible finalists.--Alexmar983 (talk) 00:32, 10 November 2019 (UTC)[reply]

Evaluation edit

Step 1 edit

  • it s the usual "round 1" on Montage (yes/no phase)
  • The 3,320 files (from 315 uploaders), all copied in the category, are sorted using Montage. They are imported in the tool with no filter. Eight jurors are involved in this preliminary phase with the thumbs up/thumbs down selection.[1]
  • The goal of this selection is to mostly remove images that are clearly unsuitable: poor resolution, people and objects obstructing the view, blurry composition and so on (and few files categorized by mistake in the competition). The core quality selection is scheduled at the next step.
  • The reasons of this selection is as follows:
  1. we are doing a test for this first edition, and we want to understand what is actually there, this way we can estimate precisely the quota of informative files before focusing on their aesthetic quality. We can also estimate the quota of uploaders of only bad files, or if there is a mixture of different quality from the same person (which might mean that some uploaders can be encouraged to focus more on this aspect)
  2. the files are supposed to be polished, so it is important to see them again during different passages to perform this task. The more they remain, the more we can improve their metadata and categories and assess the aspect we want to improve for next edition.
  3. the proposed categories of our expected finalists (coexistence of modern and classic, museum collections, landscapes and views, writings and epigraphs) are not aligned to the standard winners of WLM, with only one category ("landscapes") which perfectly fits the type of files WLM usually selects. Since many of these images are not always at the top of a unified ranking, before discharging more of them we need a reliable overall view to select the most voted among those files. We need more jurors to see more of them before creating such reliable ranking in the next rounds.

Step 2 and 3 edit

  • it is the usual "round 2" on Montage (rating phase) but it's perfomed twice. This way a very smooth final ranking is provided.
  • The "step 2" is in the end still part of the sorting phase. Normally, this could be done with a more rigid "round 1" but this was not the best strategy in our case. That's because, as pointed out in the previous section, our categories are not the standard categories of Wiki Loves Monuments and jurors have to gain expertise about them and also on the composition of the sample. Asking for a rigid selection by three random jurors would have produced probably too many false negative and positive.[2]
  • The 1,697 files (from 263 uploaders), selected from step 1 (675 3/3 and 1022 2/3), are evaluated using Montage. Six juror vote per photo.
  • Results of step 2 are listed here (ordered by decreasing value of their average)
  • The "step 3" is in charge of a smooth ranking. All jurors will vote now each photo of a much smaller set, carefully evaluating all of them. The quota of jurors from the academia increases. The scale of the previous step is now stretched taking in account more aspects, and jurors are encouraged to open every file for an accurate look.
  • The 265 files (from 98 uploaders), selected from step 2 (all file above 5.83/10.0), are evaluated using Montage. Ten juror vote per photo.
  • Results of step 3 are listed here.
  • The order changes from the previous step because the number of jurors per image has increased and there is much more attention to the categories of the competition, so they are all more represented at the top of the rank.
  • The most voted images are scrolled and a decision about the threshold of import was taken, aiming at the presence of at least two or three files per category in the final sample. Since this was not possible within a reasonable quantity (round 3 cannot be performed efficiently with too many files), an additional step is added (see below)

Step 4 edit

  • It completes the "round 2" with a selection of images with a more balanced presence of all categories. Specifically, duplicates of landscape images are drastically reduced, except of the case of images with high ranking and clearly different features (composition, moment of the day, presence of human beings, black and white).
  • The most voted 94 images of the previous round (above the average of 6.75/10.0) are reduced to 50. here.
  • Done by User:Alexmar983 in agreement with the jury.

Step 5 edit

  • It is the usual "round 3" on Montage (ranking phase)
  • The 50 files (from 27 uploaders), selected from step 4 are voted by 13 jurors. Results are listed here
  • Jurors of step 3: Alexmar983, Epìdosis, DarwIn, Camelia.boban, geraki, Neuroforever, Ivana Cerato, Richard Nevell, Aleksandra Sulikowska, Silvia Orlandi, Tyson Sukawa, Fabien Bièvre-Perrin

Step 6 edit

  • Validation by all the jurors and last refinements.
  • A runner-up was also selected, since differences are limited in the average, Similar sites in the second position are skipped to maximize diversity.
  1. ↑ it's worth noticing that in Ancient Rome the meaning was in fact reversed than nowadays. :)
  2. ↑ This is still a problem on Wiki Loves Monuments sometimes even if jurors are quite expert, it could have been an issue in this case. The "double second round" is however not a novelty: it was used also for WLM2019 in Portugal and it shows it can produce very reliable ranking.
Retrieved from "https://commons.wikimedia.org/w/index.php?title=Commons:Wiki_Loves_Classics_2019/selection&oldid=391576705"