[Script Info]
Title: 
[Events]
Format: Layer, Start, End, Style, Name, MarginL, MarginR, MarginV, Effect, Text
Dialogue: 0,0:00:00.00,0:00:12.01,Default,,0000,0000,0000,,{\i1}36C3 preroll music{\i0}
Dialogue: 0,0:00:12.01,0:00:22.72,Default,,0000,0000,0000,,Andre Klapper: Alright, thank you. Thanks\Nfor your interest. I'm Andre, I'm with the
Dialogue: 0,0:00:22.72,0:00:28.13,Default,,0000,0000,0000,,Wikimedia Foundation, and one of the\Nthings I'm currently trying to find out is
Dialogue: 0,0:00:28.13,0:00:37.09,Default,,0000,0000,0000,,how to measure activity, people in our\Ntechnical communities. And you probably
Dialogue: 0,0:00:37.09,0:00:42.02,Default,,0000,0000,0000,,know that Wikimedia is a large, large\Nproject. There's like more than 900
Dialogue: 0,0:00:42.02,0:00:47.68,Default,,0000,0000,0000,,websites, and there's many areas where you\Ncan contribute, technically, in different
Dialogue: 0,0:00:47.68,0:00:53.33,Default,,0000,0000,0000,,ways. And we're currently trying to get an\Noverview. And even that is hard.
Dialogue: 0,0:00:53.33,0:01:02.28,Default,,0000,0000,0000,,So, it is a complex task. And in this talk, I would\Nlike to quickly show you what we already
Dialogue: 0,0:01:02.28,0:01:08.22,Default,,0000,0000,0000,,have in place, and what we want to get in\Nplace, and maybe also little bits of the
Dialogue: 0,0:01:08.22,0:01:14.03,Default,,0000,0000,0000,,problems and the complexity. So, it's more\Nlike, for your interest, or if you're
Dialogue: 0,0:01:14.03,0:01:24.26,Default,,0000,0000,0000,,curious also to play with technical\Nmetrics, statistics, things like these.
Dialogue: 0,0:01:24.26,0:01:30.83,Default,,0000,0000,0000,,What we have currently is, mostly is about\Ngit repositories, code repositories, and
Dialogue: 0,0:01:30.83,0:01:35.03,Default,,0000,0000,0000,,we mostly use Gerrit for code review. We\Nhave our own Gerrit instance at
Dialogue: 0,0:01:35.03,0:01:43.32,Default,,0000,0000,0000,,gerrit.wikimedia.org. And for this we've\Nbeen having a platform called
Dialogue: 0,0:01:43.32,0:01:52.07,Default,,0000,0000,0000,,wikimedia.biterg.io. If you've seen a\NElasticSearch, Kibana, standard platform
Dialogue: 0,0:01:52.07,0:01:58.98,Default,,0000,0000,0000,,thingy, this might be familiar to you. It\Nis all Free and Open Source, it's actually
Dialogue: 0,0:01:58.98,0:02:03.26,Default,,0000,0000,0000,,a Linux Foundation project, you can find\Nit under chaoss.community, chaoss with
Dialogue: 0,0:02:03.26,0:02:09.40,Default,,0000,0000,0000,,double s, and the code base is public on\NGitHub. So any other free and open source
Dialogue: 0,0:02:09.40,0:02:14.86,Default,,0000,0000,0000,,software project can also set this up for\Nthemselves. We have it hosted by Bitergia,
Dialogue: 0,0:02:14.86,0:02:19.02,Default,,0000,0000,0000,,but this is also possible to set up\Nyourself, if you're interested in
Dialogue: 0,0:02:19.02,0:02:27.15,Default,,0000,0000,0000,,gathering statistics about your Free and\NOpen Source project. And there's also a
Dialogue: 0,0:02:27.15,0:02:36.27,Default,,0000,0000,0000,,documentation page on MediaWiki.org which\Nis called community metrics. I think I
Dialogue: 0,0:02:36.27,0:02:40.96,Default,,0000,0000,0000,,have screenshots here, because I never\Ntrust the Internet at conferences, but I
Dialogue: 0,0:02:40.96,0:02:47.32,Default,,0000,0000,0000,,could also show you live… so this is the\NGitHub page of the chaoss project by the
Dialogue: 0,0:02:47.32,0:02:55.01,Default,,0000,0000,0000,,Linux foundation where you could get the\Ncode. This is, I hope the zoom is
Dialogue: 0,0:02:55.01,0:03:03.70,Default,,0000,0000,0000,,sufficient, wikimedia.biterg.io So this is\Nthe overview page. You can see the
Dialogue: 0,0:03:03.70,0:03:12.79,Default,,0000,0000,0000,,navigation up here, and you get some basic\Nstatistics about the most active people in
Dialogue: 0,0:03:12.79,0:03:18.26,Default,,0000,0000,0000,,the git repositories, which organizations\Nwe have, so here you can see Wikimedia
Dialogue: 0,0:03:18.26,0:03:26.08,Default,,0000,0000,0000,,Foundation individuals, hello welt,\NWikimedia Deutschland. So these are, this
Dialogue: 0,0:03:26.08,0:03:31.62,Default,,0000,0000,0000,,is the contributor base we have, by\Norganization, by affiliation. And down
Dialogue: 0,0:03:31.62,0:03:37.62,Default,,0000,0000,0000,,here there's way more statistics, gits,\NGeritt, mailing lists, we index a lot of
Dialogue: 0,0:03:37.62,0:03:43.23,Default,,0000,0000,0000,,things. We also index a little bit our\Nissue tracking system, which is
Dialogue: 0,0:03:43.23,0:03:51.47,Default,,0000,0000,0000,,phabricator, and some edits on\NMediaWiki.org. And, for example, now, if I
Dialogue: 0,0:03:51.47,0:03:58.100,Default,,0000,0000,0000,,go to Gerrit and the overview page,\Nbecause we use Gerrit for code review,
Dialogue: 0,0:03:58.100,0:04:06.11,Default,,0000,0000,0000,,they have more specific statistics, and as\Nit's ElasticSearch, Kibana based, you
Dialogue: 0,0:04:06.11,0:04:09.93,Default,,0000,0000,0000,,might know this if you've played with\Nthis, whenever you click on a certain
Dialogue: 0,0:04:09.93,0:04:15.03,Default,,0000,0000,0000,,value, you can filter by that value. So,\Nfor example, if I use the pie chart here,
Dialogue: 0,0:04:15.03,0:04:19.59,Default,,0000,0000,0000,,and only want to see the numbers for\Nindependent volunteer contributors,
Dialogue: 0,0:04:19.59,0:04:26.40,Default,,0000,0000,0000,,I click it, and you see the numbers now\Nchange. Obviously a bit lower, and you see
Dialogue: 0,0:04:26.40,0:04:30.53,Default,,0000,0000,0000,,up here, that a filter has been applied,\Nand you can continue with these things.
Dialogue: 0,0:04:30.53,0:04:36.25,Default,,0000,0000,0000,,Then you can go filter here also via code\Nrepository, for example, the MediaWiki
Dialogue: 0,0:04:36.25,0:04:42.50,Default,,0000,0000,0000,,core repository. If I click on that one,\Nit also filters for the value, and you can
Dialogue: 0,0:04:42.50,0:04:49.51,Default,,0000,0000,0000,,basically drill down the statistics you\Nwant to gather here. And there's, as I
Dialogue: 0,0:04:49.51,0:04:53.87,Default,,0000,0000,0000,,only have 15 minutes, there's way more\Nthings you can find out here, also, for
Dialogue: 0,0:04:53.87,0:05:02.60,Default,,0000,0000,0000,,example, who reviews patches in Gerrit,\Nhow long patches have been open, median
Dialogue: 0,0:05:02.60,0:05:08.87,Default,,0000,0000,0000,,time, all these things you might want to\Ngather to find out how well are we doing
Dialogue: 0,0:05:08.87,0:05:15.54,Default,,0000,0000,0000,,as a project, when it comes to both\Ninvolving volunteers, and also give them
Dialogue: 0,0:05:15.54,0:05:21.35,Default,,0000,0000,0000,,the feedback when it comes to code review,\Nand engagement, that you would like to
Dialogue: 0,0:05:21.35,0:05:26.47,Default,,0000,0000,0000,,give. Or, also, areas for improvement. For\Nexample, in Wikimedia Foundation obviously
Dialogue: 0,0:05:26.47,0:05:33.10,Default,,0000,0000,0000,,we have engineering teams, and some of\Nthem maintain certain code repositories,
Dialogue: 0,0:05:33.10,0:05:39.26,Default,,0000,0000,0000,,so you can filter the view for certain\Ncode repositories, and then see, for
Dialogue: 0,0:05:39.26,0:05:44.64,Default,,0000,0000,0000,,example, you realize sometimes that\Npatches written by volunteers, it takes
Dialogue: 0,0:05:44.64,0:05:49.13,Default,,0000,0000,0000,,longer to review them than patches written\Nby your coworkers. And these kinds of
Dialogue: 0,0:05:49.13,0:05:54.18,Default,,0000,0000,0000,,things which you maybe already assumed,\Nbut it's nice to have actually data.
Dialogue: 0,0:05:54.18,0:06:02.81,Default,,0000,0000,0000,,There's also a few caveats here. So, for\Nexample, I usually don't use the git
Dialogue: 0,0:06:02.81,0:06:10.31,Default,,0000,0000,0000,,statistics, because Gerrit is where the\Ncode review happens. And once a patch
Dialogue: 0,0:06:10.31,0:06:15.43,Default,,0000,0000,0000,,proposed and Gerrit has been accepted and\Nmerged in the git repository, you would
Dialogue: 0,0:06:15.43,0:06:20.70,Default,,0000,0000,0000,,also see that in the git repository, but\Nas all our software is Open Source, Free
Dialogue: 0,0:06:20.70,0:06:26.42,Default,,0000,0000,0000,,Software, we also of course pull in a lot\Nof git repositories from other upstream
Dialogue: 0,0:06:26.42,0:06:31.02,Default,,0000,0000,0000,,projects, because we use a lot of software\Ninvented and maintained somewhere else to
Dialogue: 0,0:06:31.02,0:06:38.55,Default,,0000,0000,0000,,run our servers. So the git statistics\Nalso include activity that we've imported
Dialogue: 0,0:06:38.55,0:06:43.79,Default,,0000,0000,0000,,within the git repositories from other\Ncompanies. So, that's kind of misleading.
Dialogue: 0,0:06:43.79,0:06:48.82,Default,,0000,0000,0000,,And there's a few more caveats, which are\Nactually, I hope all of them are listed on
Dialogue: 0,0:06:48.82,0:06:54.35,Default,,0000,0000,0000,,the community metrics page on\NMediaWiki.org, because at some point I had
Dialogue: 0,0:06:54.35,0:07:01.23,Default,,0000,0000,0000,,to create a section "behavior that might\Nsurprise you". It also, that page also has
Dialogue: 0,0:07:01.23,0:07:05.82,Default,,0000,0000,0000,,some examples like, how can I, for the\Nmost common questions I get from
Dialogue: 0,0:07:05.82,0:07:12.82,Default,,0000,0000,0000,,interested people, and also co-workers,\Nor, you want to publish an annual report,
Dialogue: 0,0:07:12.82,0:07:16.30,Default,,0000,0000,0000,,and show how many volunteer contributors\Nyou have in the code bases and these
Dialogue: 0,0:07:16.30,0:07:27.87,Default,,0000,0000,0000,,things. So that is what we have. These\Nwere the screenshots in case the Wi-Fi
Dialogue: 0,0:07:27.87,0:07:35.99,Default,,0000,0000,0000,,doesn't work. And now the section, what is\Npatchwork. A spoiler: Basically everything
Dialogue: 0,0:07:35.99,0:07:43.12,Default,,0000,0000,0000,,else. Because this was the look at git and\Ngit repositories and Gerrit for code
Dialogue: 0,0:07:43.12,0:07:49.48,Default,,0000,0000,0000,,review. But there is way more going on\Nwhen it comes to technical contributions
Dialogue: 0,0:07:49.48,0:07:58.59,Default,,0000,0000,0000,,and code in Wikimedia. There is GitHub.\NSo, we have some projects, quite a few,
Dialogue: 0,0:07:58.59,0:08:02.46,Default,,0000,0000,0000,,that don't use Wikimedia git, Wikimedia\NGerrit, but they prefer GitHub, because
Dialogue: 0,0:08:02.46,0:08:10.86,Default,,0000,0000,0000,,it's a different contribution system or\Nworkflow. So, we already track some of
Dialogue: 0,0:08:10.86,0:08:15.84,Default,,0000,0000,0000,,that, but we still have to improve even\Nfinding a way how to find all the
Dialogue: 0,0:08:15.84,0:08:20.10,Default,,0000,0000,0000,,repositories related to Wikimedia\NDevelopment on GitHub. Because they're not
Dialogue: 0,0:08:20.10,0:08:27.09,Default,,0000,0000,0000,,all under the same organization. When it\Ncomes to what I just showed you,
Dialogue: 0,0:08:27.09,0:08:33.65,Default,,0000,0000,0000,,wikimedia.biterg.io, we define what is\Nbeing indexed in a public JSON file,
Dialogue: 0,0:08:33.65,0:08:38.41,Default,,0000,0000,0000,,"projects". So, this is also linked from\Nthe community metrics page on
Dialogue: 0,0:08:38.41,0:08:43.38,Default,,0000,0000,0000,,mediawiki.org, where we define basically\Nwhat's, what gets indexed. And it's a long
Dialogue: 0,0:08:43.38,0:08:50.58,Default,,0000,0000,0000,,list as you can say– see, also some\Nmailing lists, but there's a lot of code
Dialogue: 0,0:08:50.58,0:08:57.15,Default,,0000,0000,0000,,actually on the Wikis. Inside of Wiki\Npages. So, there are user scripts, there
Dialogue: 0,0:08:57.15,0:09:02.83,Default,,0000,0000,0000,,are gadgets, like small JavaScript things\Nthat enhance functionality, and they're
Dialogue: 0,0:09:02.83,0:09:08.76,Default,,0000,0000,0000,,actually quite common. So, for example,\NWikimedia Commons, or English or German
Dialogue: 0,0:09:08.76,0:09:15.06,Default,,0000,0000,0000,,Wikipedia, they have a lot of gadgets even\Nenabled by default, which makes some
Dialogue: 0,0:09:15.06,0:09:22.28,Default,,0000,0000,0000,,behavior easier. For example, on Commons a\Ncommon gadget is adding a category to a
Dialogue: 0,0:09:22.28,0:09:26.64,Default,,0000,0000,0000,,photo or image that has been uploaded.\NThat's way easier if you use a gadget
Dialogue: 0,0:09:26.64,0:09:34.24,Default,,0000,0000,0000,,which is enabled by default. There are Lua\Nmodules, and there's templates. For
Dialogue: 0,0:09:34.24,0:09:39.24,Default,,0000,0000,0000,,example the info boxes that you see in\Nmany Wikipedia articles on the side, for
Dialogue: 0,0:09:39.24,0:09:43.84,Default,,0000,0000,0000,,example, if you look up a Wikipedia\Narticle about a person. These are all
Dialogue: 0,0:09:43.84,0:09:51.01,Default,,0000,0000,0000,,templates. And they're all stored on Wiki.\NSo, this is harder to track, to get a full
Dialogue: 0,0:09:51.01,0:10:00.08,Default,,0000,0000,0000,,overview of that. And some extension code,\Neven we have about 130 MediaWiki
Dialogue: 0,0:10:00.08,0:10:06.45,Default,,0000,0000,0000,,extensions deployed on Wikimedia servers.\NBut if you take a look only at the
Dialogue: 0,0:10:06.45,0:10:11.86,Default,,0000,0000,0000,,extension home pages or MediaWiki.org,\Nthere is more than 2000. So there's a lot
Dialogue: 0,0:10:11.86,0:10:16.10,Default,,0000,0000,0000,,of code out there, and sometimes this code\Nis even stored just by copy and paste
Dialogue: 0,0:10:16.10,0:10:20.51,Default,,0000,0000,0000,,putting it on a Wiki page, and saying:\Nhere, copy and paste this, and it should
Dialogue: 0,0:10:20.51,0:10:26.72,Default,,0000,0000,0000,,work. Which might not be the best revision\Nsystem when it comes to maintaining code,
Dialogue: 0,0:10:26.72,0:10:33.14,Default,,0000,0000,0000,,ever, but it's a quick and dirty way, so\Nthese things exist. And one other example,
Dialogue: 0,0:10:33.14,0:10:40.20,Default,,0000,0000,0000,,unknown code repository locations. We also\Nhave something called ToolForge. That's
Dialogue: 0,0:10:40.20,0:10:44.92,Default,,0000,0000,0000,,what some people call "cloud services"\Nnowadays. So you can host your own little
Dialogue: 0,0:10:44.92,0:10:50.58,Default,,0000,0000,0000,,helper tools which other people then can\Nalso use, on a cloud services platform
Dialogue: 0,0:10:50.58,0:10:55.07,Default,,0000,0000,0000,,called ToolForge that we offer. One\Nexample would be, for example, page views.
Dialogue: 0,0:10:55.07,0:11:02.77,Default,,0000,0000,0000,,So, if you want to see which pages are the\Nmost popular on some Wiki, that's one
Dialogue: 0,0:11:02.77,0:11:08.32,Default,,0000,0000,0000,,example out of, also thousands of tools\Nnow actually. And though, of course, the
Dialogue: 0,0:11:08.32,0:11:14.02,Default,,0000,0000,0000,,rules are that you must publish the source\Ncode, it's sometimes really hard to also
Dialogue: 0,0:11:14.02,0:11:18.25,Default,,0000,0000,0000,,make sure that this happens, and where it\Nhappens. So for most repositories, we
Dialogue: 0,0:11:18.25,0:11:23.33,Default,,0000,0000,0000,,know, we have an index, but for some we\Nactually don't know, which is also
Dialogue: 0,0:11:23.33,0:11:31.79,Default,,0000,0000,0000,,something to work out. So, recently, even\Ngetting a number of things, or getting an
Dialogue: 0,0:11:31.79,0:11:38.79,Default,,0000,0000,0000,,idea, like, what what can we measure, what\Ndo we have, how much do we have, I started
Dialogue: 0,0:11:38.79,0:11:43.83,Default,,0000,0000,0000,,to create a table, and even visualizing\Nthat was, was an interesting task. I'm
Dialogue: 0,0:11:43.83,0:11:49.44,Default,,0000,0000,0000,,still not sure if anybody understands\Nthis, but black basically means doesn't
Dialogue: 0,0:11:49.44,0:11:55.97,Default,,0000,0000,0000,,exist. You don't need to, there is nothing\Nto, to measure, to index. Green means, yes
Dialogue: 0,0:11:55.97,0:12:02.83,Default,,0000,0000,0000,,we do measure this already. And the red\Nones mean, yellow means, it's tricky, but
Dialogue: 0,0:12:02.83,0:12:09.46,Default,,0000,0000,0000,,it's kind of possible via some scripts or\Nusing the API to get numbers out of the
Dialogue: 0,0:12:09.46,0:12:15.42,Default,,0000,0000,0000,,Wikis, in certain name spaces, for example\Nthe module name space. And red means, it's
Dialogue: 0,0:12:15.42,0:12:22.60,Default,,0000,0000,0000,,very hard, but we'd like to get this data\Nat some point. Plus, also the complexity,
Dialogue: 0,0:12:22.60,0:12:28.58,Default,,0000,0000,0000,,so the numbers you see here is sometimes\Ncorrect numbers, sometimes more of a
Dialogue: 0,0:12:28.58,0:12:34.67,Default,,0000,0000,0000,,ballpark vague figure about how many\Nitems, code repositories, projects we're
Dialogue: 0,0:12:34.67,0:12:39.09,Default,,0000,0000,0000,,actually talking about. And with some\Nnumbers, we're even wondering. For
Dialogue: 0,0:12:39.09,0:12:46.20,Default,,0000,0000,0000,,example, it says 270 000 modules and\Ntemplates on the 900 sites, websites
Dialogue: 0,0:12:46.20,0:12:53.02,Default,,0000,0000,0000,,we have on Wikimedia servers, and this is\Nwhat the database query says on hive, but
Dialogue: 0,0:12:53.02,0:12:58.18,Default,,0000,0000,0000,,we're not really trusting that number yet.\NSo, this is actually what we're going to
Dialogue: 0,0:12:58.18,0:13:03.14,Default,,0000,0000,0000,,be after over the next months to also have\Nway better data, and a way better overview
Dialogue: 0,0:13:03.14,0:13:07.89,Default,,0000,0000,0000,,of where our developers actually are.\NBecause we know, in code repositories, we
Dialogue: 0,0:13:07.89,0:13:17.21,Default,,0000,0000,0000,,have about 200 to 400 code contributors,\Nin Gerrit code review, per month.
Dialogue: 0,0:13:17.21,0:13:24.48,Default,,0000,0000,0000,,And we now also know that we have about 500,\N600 people who work on user scripts and
Dialogue: 0,0:13:24.48,0:13:30.62,Default,,0000,0000,0000,,gadgets, per year. But for many other\Nthings, we don't know yet, and that's what
Dialogue: 0,0:13:30.62,0:13:36.20,Default,,0000,0000,0000,,I'm trying to improve over the next\Nmonths, or, maybe realistically, years.
Dialogue: 0,0:13:36.20,0:13:45.30,Default,,0000,0000,0000,,Let's see. But, yeah. So, that's basically\Nit. I hope this was a bit interesting.
Dialogue: 0,0:13:45.30,0:13:51.09,Default,,0000,0000,0000,,If you have any comments, questions, feel\Nfree to catch me here. I'm sometimes
Dialogue: 0,0:13:51.09,0:13:56.33,Default,,0000,0000,0000,,around the table. Feel free to catch me\Nafter this talk. These are links with more
Dialogue: 0,0:13:56.33,0:14:03.02,Default,,0000,0000,0000,,information, or, if you don't manage to\Ncatch me, feel also free on the community
Dialogue: 0,0:14:03.02,0:14:09.11,Default,,0000,0000,0000,,metrics page on MediaWiki.org, the first\Nlink, there is a discussion page, and
Dialogue: 0,0:14:09.11,0:14:14.94,Default,,0000,0000,0000,,there you can also bring up anything,\Nideas, ask questions, I watch that page,
Dialogue: 0,0:14:14.94,0:14:18.15,Default,,0000,0000,0000,,and, usually, reply. Thank you!
Dialogue: 0,0:14:18.15,0:14:21.05,Default,,0000,0000,0000,,{\i1}applause{\i0}
Dialogue: 0,0:14:21.05,0:14:24.81,Default,,0000,0000,0000,,{\i1}postroll music{\i0}
Dialogue: 0,0:14:24.81,0:14:48.00,Default,,0000,0000,0000,,Subtitles created by c3subtitles.de\Nin the year 2021. Join, and help us!