1
99:59:59,999 --> 99:59:59,999
Herald: Hello and welcome to
Infrastructure Review. This review is

2
99:59:59,999 --> 99:59:59,999
being translated into a lot of languages
and we don't know yet which one, but the

3
99:59:59,999 --> 99:59:59,999
c3lingo team will be on stage and will
tell us how and what it did. I'd like to

4
99:59:59,999 --> 99:59:59,999
start, as always and every year, with the
NOC, right. So please give the NOC a hand.

5
99:59:59,999 --> 99:59:59,999
*applause*
[Filler, please remove me in amara]

6
99:59:59,999 --> 99:59:59,999
Momo: All right, everyone, welcome to the
State of the Internet manufacture report.

7
99:59:59,999 --> 99:59:59,999
This is JC, I'm Momo and we're going to
talk to you about what we did this year

8
99:59:59,999 --> 99:59:59,999
for the network. So obviously, organizing
Congress is a quite tedious task. Took us

9
99:59:59,999 --> 99:59:59,999
about six months of pre-planning. We came
in on the 15th, did a fiber day and then

10
99:59:59,999 --> 99:59:59,999
it took us from the 18th and will take us
till tomorrow to tear everything down with

11
99:59:59,999 --> 99:59:59,999
like 20 to 40 people. And we'll be busy
wiping every device because that is

12
99:59:59,999 --> 99:59:59,999
actually what we do every year. We delete
everything. There are no logs leaving this

13
99:59:59,999 --> 99:59:59,999
building and this will take us probably
the next 24 hours. So yeah, for the usual

14
99:59:59,999 --> 99:59:59,999
numbers.  Edge capacity: this year because
you didn't use all the Internet last year,

15
99:59:59,999 --> 99:59:59,999
we only brought you 300 gigs, but that was
fine as well, I suppose. We got 100 gig

16
99:59:59,999 --> 99:59:59,999
from HLKomm here in Leipzig, 100 gig from
Deutsche Telekom and as well as 100 gig

17
99:59:59,999 --> 99:59:59,999
from BCIX which we got via DWDM wave to
Berlin. In the core we used Juniper

18
99:59:59,999 --> 99:59:59,999
MX960s, MX480s, MX204s and QFX10002 in the
yolocolo. Basically all the halls were

19
99:59:59,999 --> 99:59:59,999
connected via a 200 gig link and yolocolo
had three times 100 gig. As probably the

20
99:59:59,999 --> 99:59:59,999
last five or so years, we're using IS-IS
and BGP for our protocols of choice. And

21
99:59:59,999 --> 99:59:59,999
this year we also first off rejected RPKI
invalid routes and secondly applied for

22
99:59:59,999 --> 99:59:59,999
the first time at congress BCP38 ingress
filtering to be a good internet citizen

23
99:59:59,999 --> 99:59:59,999
and not to allow you to spoof IP
addresses. So yeah, that was nice. As

24
99:59:59,999 --> 99:59:59,999
Congress keeps on growing, we have 2500
tables somewhere around the building in

25
99:59:59,999 --> 99:59:59,999
all the assemblies, but we only have 300
switches. So sorry if you had to bring a

26
99:59:59,999 --> 99:59:59,999
long cable and if you have switches to
spare with 10 gig uplinks and POE+, feel

27
99:59:59,999 --> 99:59:59,999
free to donate them to us. Access and Wi-
Fi. We had like 300 access switches. We

28
99:59:59,999 --> 99:59:59,999
are obviously again running Aruba Wi-Fi
controllers. This year, like at camp we

29
99:59:59,999 --> 99:59:59,999
had a few 802.1x access points, more on
that later. We tried to use Juniper vMX to

30
99:59:59,999 --> 99:59:59,999
route the Wi-Fi traffic. And had quite a
shitload of switches, most of them from

31
99:59:59,999 --> 99:59:59,999
Juniper, some Cisco 2960s, some Brocades
which are new to us, and some crappy old

32
99:59:59,999 --> 99:59:59,999
HPE stuff which is basically configured
for us to work like a brick you get from

33
99:59:59,999 --> 99:59:59,999
like eBay or whatnot. We had a few
incidents this year we'd like to talk

34
99:59:59,999 --> 99:59:59,999
about. First off, we had, I'm not sure if
any of you noticed, quite a lot of packet

35
99:59:59,999 --> 99:59:59,999
loss and missing router advertisements on
the Wi-Fi. This was caused by some weird

36
99:59:59,999 --> 99:59:59,999
Juniper vMX behavior. We couldn't figure
out what it was. So we had them running in

37
99:59:59,999 --> 99:59:59,999
a redundant VRRP setup. We shut down one
of them and then it worked. So yeah, fuck

38
99:59:59,999 --> 99:59:59,999
redundancy. There was a pixelflut client
which somehow messed up his IP address and

39
99:59:59,999 --> 99:59:59,999
caused a broadcast storm which took down
most parts of Hall 2. We found them, shut

40
99:59:59,999 --> 99:59:59,999
it down and deployed storm control to all
our access switches. Yeah, to the Congress

41
99:59:59,999 --> 99:59:59,999
motto resource exhaustion: someone was
running aggressive zmap scanning over the

42
99:59:59,999 --> 99:59:59,999
whole internet, came by our Wi-Fi access
controller and caused a state table

43
99:59:59,999 --> 99:59:59,999
exhaustion. And that brought it down. We
null-routed the source and yeah, there was

44
99:59:59,999 --> 99:59:59,999
this issue. So thank you to whoever was
that. And in the morning of day 3, we had

45
99:59:59,999 --> 99:59:59,999
another issue with Juniper vMX where it
forgot it had a network card. We rebooted

46
99:59:59,999 --> 99:59:59,999
it and everything was fine again. So yeah,
some numbers. You actually managed to use

47
99:59:59,999 --> 99:59:59,999
more bandwidth, thank you.
[Filler, please remove me in amara]

48
99:59:59,999 --> 99:59:59,999
*applause*
[Filler, please remove me in amara]

49
99:59:59,999 --> 99:59:59,999
M: But it's still only 20% of our uplink
capacity. So use more. 20% of that was

50
99:59:59,999 --> 99:59:59,999
IPv6, which is good, but could be more. We
had like 11000 clients into Wi-Fi.  86% 5

51
99:59:59,999 --> 99:59:59,999
GHz, 96% in a peak.
We had eleven 802.11ax clients. Our

52
99:59:59,999 --> 99:59:59,999
favorite one was obviously the one with
the lovely hostname ILOVETHENOC. So yeah,

53
99:59:59,999 --> 99:59:59,999
about that number we have, 96% 5 GHz
obviously shows us that we are finally at

54
99:59:59,999 --> 99:59:59,999
the point where we can say: thank you 2.4
GHz, it was nice. Goodbye.

55
99:59:59,999 --> 99:59:59,999
*applause*
[Filler, please remove me in amara]

56
99:59:59,999 --> 99:59:59,999
M: Also, obviously, thank you to our
sponsors. We couldn't do this if we would

57
99:59:59,999 --> 99:59:59,999
not get like 10 millions, of list price
obviously, of equipment and loan and quite

58
99:59:59,999 --> 99:59:59,999
a lot of services. So give them a round of
applause as well. Thank you.

59
99:59:59,999 --> 99:59:59,999
*applause*
[Filler, please remove me in amara]

60
99:59:59,999 --> 99:59:59,999
M: And obviously NOC not only stands for
Network Operation Center, but if you

61
99:59:59,999 --> 99:59:59,999
extend it, it is No CO2. So we believe in
green power and clean traffic and

62
99:59:59,999 --> 99:59:59,999
therefore we obviously see that
sustainability is a great part of our

63
99:59:59,999 --> 99:59:59,999
role. This is why we even use old crappy
HP switches to cut our lines for our

64
99:59:59,999 --> 99:59:59,999
tchunk to serve your cheese boards,
whatever you need.

65
99:59:59,999 --> 99:59:59,999
*laughter*
[Filler, please remove me in amara]

66
99:59:59,999 --> 99:59:59,999
M: Also...
[Filler, please remove me in amara]

67
99:59:59,999 --> 99:59:59,999
*applause*
[Filler, please remove me in amara]

68
99:59:59,999 --> 99:59:59,999
M: Also, we somehow estimated what our
network will run us in CO2 and that was

69
99:59:59,999 --> 99:59:59,999
about 11 tons. We're not very good with
mass and not very good with CO2 emissions,

70
99:59:59,999 --> 99:59:59,999
but this was roughly what we came up with.
And to make Congress or the world a bit

71
99:59:59,999 --> 99:59:59,999
better place, we actually offset all our
CO2 and bought eleven tons of CO2

72
99:59:59,999 --> 99:59:59,999
emissions. And now Frederick is gonna tell
you how we got all those numbers.

73
99:59:59,999 --> 99:59:59,999
Frederick: Yeah, as a good internet
manufacture, we also do monitoring a lot

74
99:59:59,999 --> 99:59:59,999
and we run our own Prometheus server
inside. You probably know the dashboard

75
99:59:59,999 --> 99:59:59,999
that we propagate all over the internet
and that's powered by Prometheus. We have

76
99:59:59,999 --> 99:59:59,999
an internal Grafana that is part of this
whole ecosystem. And if you are a little

77
99:59:59,999 --> 99:59:59,999
bit of a nerd, you might have clicked on
the dashboard sections and seen that there

78
99:59:59,999 --> 99:59:59,999
are more dashboards than this. We fill our
Prometheus with lots of different sources:

79
99:59:59,999 --> 99:59:59,999
we get SNMP data from, and screw SNMP, but
it does a quite good job at getting all

80
99:59:59,999 --> 99:59:59,999
the insights we need from all the network
equipment. We have node_exporter, influx

81
99:59:59,999 --> 99:59:59,999
and all that, but we got a decent amount
of data from everyone in the Congress

82
99:59:59,999 --> 99:59:59,999
ecosystem and we had that at camp as well
where we got the water pressure of the

83
99:59:59,999 --> 99:59:59,999
showers. And we get the colo power, which
also helps with estimating the CO2

84
99:59:59,999 --> 99:59:59,999
footprint. And everything is being
configured by Netbox, which is a tool that

85
99:59:59,999 --> 99:59:59,999
is an asset database. And as I said, we
have lots of dashboards and graphs. Of

86
99:59:59,999 --> 99:59:59,999
course, the public one where you can see
lots of different things from everyone.

87
99:59:59,999 --> 99:59:59,999
This is only part of it. If you scroll
down on the dashboard, you see a lot more.

88
99:59:59,999 --> 99:59:59,999
But this helps everyone to have a good
understanding of what is happening

89
99:59:59,999 --> 99:59:59,999
currently. And we even draw a nice little
Christmas trees on the Wi-Fi traffic for

90
99:59:59,999 --> 99:59:59,999
you. That is mostly because it's a router-
on-a-stick and we cannot measure it

91
99:59:59,999 --> 99:59:59,999
correctly. We have an internal dashboard
which gives us a little bit of a status

92
99:59:59,999 --> 99:59:59,999
for build-up mostly: which switches and
routers are up? And that gives us a very

93
99:59:59,999 --> 99:59:59,999
quick sight of all the devices that are
out there. What's broken? What's not

94
99:59:59,999 --> 99:59:59,999
broken? We improved it a little and now
have alarms so someone can look at stuff

95
99:59:59,999 --> 99:59:59,999
and see if things are broken, run out
there and fix it. We also built

96
99:59:59,999 --> 99:59:59,999
weathermaps. As you can see that's a
little bit of a mess. But we couldn't do

97
99:59:59,999 --> 99:59:59,999
it better because the graphing library
doesn't allow us to do it better. If

98
99:59:59,999 --> 99:59:59,999
someone has a good idea to do it better in
Grafana or anywhere else with sources from

99
99:59:59,999 --> 99:59:59,999
Prometheus, please come to us, we're happy
to talk. But this shows our core and all

100
99:59:59,999 --> 99:59:59,999
the links between it and how much capacity
is being used. Red indicates that it's

101
99:59:59,999 --> 99:59:59,999
used more heavily. We also have that for
the yolocolo. And all the traffic around

102
99:59:59,999 --> 99:59:59,999
it as well. And, yeah, teardown starts
now. Please don't touch our equipment. And

103
99:59:59,999 --> 99:59:59,999
if you want to come and help, please come
to Hall 4 and get in touch. We always need

104
99:59:59,999 --> 99:59:59,999
helping hands. But please in an organized
way don't disassemble switches or access

105
99:59:59,999 --> 99:59:59,999
points. We have lists and everything. We
need to account for everything. So please

106
99:59:59,999 --> 99:59:59,999
come to Hall 4 if you want to help. And
yes, use more bandwidth and offset more

107
99:59:59,999 --> 99:59:59,999
CO2. Thank you.
[Filler, please remove me in amara]

108
99:59:59,999 --> 99:59:59,999
*applause*
[Filler, please remove me in amara]

109
99:59:59,999 --> 99:59:59,999
H: So thanks a lot. Actually, because
you're clearly the backbone or one of

110
99:59:59,999 --> 99:59:59,999
those many backbones of the conference, is
there any Q? Let's do a Q&A for like one

111
99:59:59,999 --> 99:59:59,999
or two questions.
Is anyone having a question right now?

112
99:59:59,999 --> 99:59:59,999
Someone is standing up. Right, microphone
number one, please.

113
99:59:59,999 --> 99:59:59,999
Q: Hey, we've absolutely don't ...
[Filler, please remove me in amara]

114
99:59:59,999 --> 99:59:59,999
H: Nearer, nearer.
[Filler, please remove me in amara]

115
99:59:59,999 --> 99:59:59,999
Q:  We've absolutely done bcp38 in
previous years, by the way.

116
99:59:59,999 --> 99:59:59,999
M: Sorry for what I said then, I'm sorry.
Q: So I wanted to correct the record.

117
99:59:59,999 --> 99:59:59,999
We've been good netizens in previous years
as well.

118
99:59:59,999 --> 99:59:59,999
H: Oh, you're right. Thank you. Was there
another question or something else to

119
99:59:59,999 --> 99:59:59,999
correct them? Because they clearly don't
know what they're doing.

120
99:59:59,999 --> 99:59:59,999
*laughter*
[Filler, please remove me in amara]

121
99:59:59,999 --> 99:59:59,999
H: Yeah. Feel free. Microphone number two.
Q: So if 2.4GHz is over, what's going to

122
99:59:59,999 --> 99:59:59,999
happen to all of the ESP32 in various IoT
devices? Are they going to have a home

123
99:59:59,999 --> 99:59:59,999
here next year?
M: They'll definitely have a home. But as

124
99:59:59,999 --> 99:59:59,999
usual, we cannot support it as good as we
can on 5GHz because obviously this band is

125
99:59:59,999 --> 99:59:59,999
overused and not even remotely suited for
that amount of clients we put on it.

126
99:59:59,999 --> 99:59:59,999
Q: A follow-up for the ESP32. How exactly
can you locate them through the wireless

127
99:59:59,999 --> 99:59:59,999
if they are lost?
M: Well, we can't. We can basically look

128
99:59:59,999 --> 99:59:59,999
at which access point they are, and then
if someone really would want to, we could

129
99:59:59,999 --> 99:59:59,999
start triangulation, but we've never done
that before. So yeah, we can just pin them

130
99:59:59,999 --> 99:59:59,999
roughly to an access point.
H: Maybe we can ask c3nav next time. So

131
99:59:59,999 --> 99:59:59,999
please give the NOC a hand.
Thank you.

132
99:59:59,999 --> 99:59:59,999
*applause*
[Filler, please remove me in amara]

133
99:59:59,999 --> 99:59:59,999
H: So, the next team up is the POC. Do we
have to click this? Use more bandwidth,

134
99:59:59,999 --> 99:59:59,999
I'm going to try. Ah! Thank you. Your
stage.

135
99:59:59,999 --> 99:59:59,999
Garvin: Thanks.
[Filler, please remove me in amara]

136
99:59:59,999 --> 99:59:59,999
*applause*
[Filler, please remove me in amara]

137
99:59:59,999 --> 99:59:59,999
Maria: Hi, my name is Maria.
[Filler, please remove me in amara]

138
99:59:59,999 --> 99:59:59,999
G: Hi, and I'm Garvin and we're from Phone
Operation Center and we want to talk a bit

139
99:59:59,999 --> 99:59:59,999
about the phone infrastructure at this
event.

140
99:59:59,999 --> 99:59:59,999
M: Yeah. So we arrived at day -6 and
planned on hacking some things

141
99:59:59,999 --> 99:59:59,999
and socializing and we planned a team
event, but then everything was different.

142
99:59:59,999 --> 99:59:59,999
G: Yeah. When we arrived, I went into the
NOC office and they said to me, "Ja, CCL

143
99:59:59,999 --> 99:59:59,999
is up, internet is up, everything is just
working nicely. You can start hook up your

144
99:59:59,999 --> 99:59:59,999
telephony system right now." And I was
like, whoa. So thanks a lot NOC. Really

145
99:59:59,999 --> 99:59:59,999
great performance this year, we were
amazed. Nobody expected that it works so

146
99:59:59,999 --> 99:59:59,999
well.
[Filler, please remove me in amara]

147
99:59:59,999 --> 99:59:59,999
*applause*
[Filler, please remove me in amara]

148
99:59:59,999 --> 99:59:59,999
M: Yeah. So we put up the first antennas
and then we decided to have our team event

149
99:59:59,999 --> 99:59:59,999
anyway. And yeah, so we did a lot of
things. So we handed out 150 orga loan

150
99:59:59,999 --> 99:59:59,999
DECTs and we deployed 51 SIP telephones.
We also deployed 67 antennas and we had a

151
99:59:59,999 --> 99:59:59,999
POC party on day three until 7:30 a.m.
G: So you can see almost everything is

152
99:59:59,999 --> 99:59:59,999
done. I guess the remaining things are not
that important. So this is the overview of

153
99:59:59,999 --> 99:59:59,999
DECT coverage at the event. Only level
zero, because otherwise I think it would

154
99:59:59,999 --> 99:59:59,999
be overcrowded to show. Just so that you
can get a rough impression on how many

155
99:59:59,999 --> 99:59:59,999
antennas we deployed in order to give you
this DECT coverage. That you can be

156
99:59:59,999 --> 99:59:59,999
reached almost everywhere in the event and
that you can see how our tooling looks

157
99:59:59,999 --> 99:59:59,999
like, where we see how good the antennas
see each other, and that we can see that

158
99:59:59,999 --> 99:59:59,999
seamless handover work so that you can
start at our desk, walk through the area,

159
99:59:59,999 --> 99:59:59,999
into the lounge and just continue talking.
And oh, there are also some antennas that

160
99:59:59,999 --> 99:59:59,999
are outside of the building. What could
that be?

161
99:59:59,999 --> 99:59:59,999
M: That is our hotel DECT. And you can see
a typical hotel DECT installation on the

162
99:59:59,999 --> 99:59:59,999
photo. And people got really confused
about it because we also had DECT coverage

163
99:59:59,999 --> 99:59:59,999
at main station.
G: Yeah. So I got a call roughly at 4:00

164
99:59:59,999 --> 99:59:59,999
p.m. in the morning.
[Filler, please remove me in amara]

165
99:59:59,999 --> 99:59:59,999
*applause*
[Filler, please remove me in amara]

166
99:59:59,999 --> 99:59:59,999
G: And somebody told me. Oh, my DECT rang.
Why? Now I need to turn it off at the

167
99:59:59,999 --> 99:59:59,999
night. Why did you do this?
M: Yeah. So we also had problems. We have

168
99:59:59,999 --> 99:59:59,999
a new feature since Camp where you can see
your DECT devices and can assign them to

169
99:59:59,999 --> 99:59:59,999
your number before you even arrive, and
then everything is set up and you don't

170
99:59:59,999 --> 99:59:59,999
have to call your token anymore. And
people get really confused because they

171
99:59:59,999 --> 99:59:59,999
would call their token anyway and it calls
it invalid. So we had to explain a lot of

172
99:59:59,999 --> 99:59:59,999
this unexpected simplicity to them.
G: And then we had a battery issue this

173
99:59:59,999 --> 99:59:59,999
year. We had not enough batteries and, you
know, batteries are always empty in the

174
99:59:59,999 --> 99:59:59,999
phones when it's the most important. So we
were thinking what what can we do about

175
99:59:59,999 --> 99:59:59,999
that?
M: So we build a new device. That's our

176
99:59:59,999 --> 99:59:59,999
microwave and it can also charge devices.
So, many thanks to C3Power, because they

177
99:59:59,999 --> 99:59:59,999
helped us with tooling and actually they
have expertise to put power cables on

178
99:59:59,999 --> 99:59:59,999
devices like this. Thank you very much.
[Filler, please remove me in amara]

179
99:59:59,999 --> 99:59:59,999
*applause*
[Filler, please remove me in amara]

180
99:59:59,999 --> 99:59:59,999
G: In the last years we were often asked
"how expensive is your service actually?".

181
99:59:59,999 --> 99:59:59,999
So we decided that we now provide invoices
so you can see how expensive our services

182
99:59:59,999 --> 99:59:59,999
are and we send out a lot of invoices. And
we got paid some money. But as you can see

183
99:59:59,999 --> 99:59:59,999
on the invoices, most is sponsored by CCC.
M: Yeah. And people also paid with Mate

184
99:59:59,999 --> 99:59:59,999
which is really awesome.
G: Yeah. And also people have invoices on

185
99:59:59,999 --> 99:59:59,999
a fraction of a cent and they got quite
creative on how they can pay us.

186
99:59:59,999 --> 99:59:59,999
*laughter*
[Filler, please remove me in amara]

187
99:59:59,999 --> 99:59:59,999
*applause*
[Filler, please remove me in amara]

188
99:59:59,999 --> 99:59:59,999
M: So here are some more stats. We have
7473 registered extensions.

189
99:59:59,999 --> 99:59:59,999
G: Oh, we didn't remove this. So we were
thinking on how to compare this with

190
99:59:59,999 --> 99:59:59,999
things and we were looking at villages in
Saarland and then we thought, this is a

191
99:59:59,999 --> 99:59:59,999
stupid comparison, but we didn't remove
this.

192
99:59:59,999 --> 99:59:59,999
M: So there were 5021 attached DECT phones
and 3251 concurrent DECT phones. Which is

193
99:59:59,999 --> 99:59:59,999
about more than 1000 more than last year.
G: So thanks a lot for using DECT.

194
99:59:59,999 --> 99:59:59,999
M: Yeah. We had...
[Filler, please remove me in amara]

195
99:59:59,999 --> 99:59:59,999
*applause*
[Filler, please remove me in amara]

196
99:59:59,999 --> 99:59:59,999
M: There were also max 120 calls in
parallel, and we had more than 300

197
99:59:59,999 --> 99:59:59,999
thousand calls in total. That's also
really, really much. We had five eating

198
99:59:59,999 --> 99:59:59,999
meetings at heaven, the angel eating
place, and there were an average of 42

199
99:59:59,999 --> 99:59:59,999
eating meeting live viewers. We had two
lectures. You can see them on media.ccc.de

200
99:59:59,999 --> 99:59:59,999
and we had 23 super fast charged phones in
our microwave.

201
99:59:59,999 --> 99:59:59,999
*applause*
[Filler, please remove me in amara]

202
99:59:59,999 --> 99:59:59,999
G: Like the NOC, we also had to deal a bit
with issues during the event, and actually

203
99:59:59,999 --> 99:59:59,999
there were some DDOS attack on our account
system and somebody configured over 4000

204
99:59:59,999 --> 99:59:59,999
extensions with really stupid names. And
it took us quite a while to get rid of

205
99:59:59,999 --> 99:59:59,999
them again cleanly from the system because
the synchronization turned out to be

206
99:59:59,999 --> 99:59:59,999
really slow. So you can see it took us a
while to get them removed again. So we can

207
99:59:59,999 --> 99:59:59,999
only say, you all know it's a hacker
congress, but it's kind of stupid to hack

208
99:59:59,999 --> 99:59:59,999
your own infrastructure.
[Filler, please remove me in amara]

209
99:59:59,999 --> 99:59:59,999
*applause*
[Filler, please remove me in amara]

210
99:59:59,999 --> 99:59:59,999
G: So as a consequence of this, we only
allow now only 50 extensions per account

211
99:59:59,999 --> 99:59:59,999
and per event. If you think you need more,
feel free to contact us if you have a

212
99:59:59,999 --> 99:59:59,999
valid use case.
[Filler, please remove me in amara]

213
99:59:59,999 --> 99:59:59,999
M: So every device has an IPEI that is
like a MAC address and we ask the

214
99:59:59,999 --> 99:59:59,999
responsible institution to give us the
manufacturer. But it's really secret. So

215
99:59:59,999 --> 99:59:59,999
they don't give it to us. So we ask you
for help. Please enter the models of your

216
99:59:59,999 --> 99:59:59,999
devices for your phones. And then we can
match to the IPEI and get some data to

217
99:59:59,999 --> 99:59:59,999
build more awesome features for you.
[Filler, please remove me in amara]

218
99:59:59,999 --> 99:59:59,999
G: This would really help us. And the only
way for us is to crowdsource it because it

219
99:59:59,999 --> 99:59:59,999
seems to be super secret. Whatever.
[Filler, please remove me in amara]

220
99:59:59,999 --> 99:59:59,999
M: You can find it in guru3 on the device
page and there's this little pen. And if

221
99:59:59,999 --> 99:59:59,999
you click on it, then you can enter the
model.

222
99:59:59,999 --> 99:59:59,999
G: Thanks upfront. And yep, that's from
us, and I guess now we have a little time

223
99:59:59,999 --> 99:59:59,999
for you to ask questions.
[Filler, please remove me in amara]

224
99:59:59,999 --> 99:59:59,999
*applause*
[Filler, please remove me in amara]

225
99:59:59,999 --> 99:59:59,999
H: Great. So, any questions for the POC? I
don't see... were they correct or do we

226
99:59:59,999 --> 99:59:59,999
have to...? Ah, someone is getting up. So
microphone number 1, please.

227
99:59:59,999 --> 99:59:59,999
Q: Yes, a few years ago there was a
translation service via DECT. Is the

228
99:59:59,999 --> 99:59:59,999
capacity enough to service also this
crowd?

229
99:59:59,999 --> 99:59:59,999
G: The problem is that we switched the
phone system a while ago last year at the

230
99:59:59,999 --> 99:59:59,999
Congress. And the old phone system had a
way how we can do the translation via one

231
99:59:59,999 --> 99:59:59,999
channel and the problem is that the new
system doesn't support this. Let me say

232
99:59:59,999 --> 99:59:59,999
the new system doesn't support it yet. So
have a look at our talk and then you can

233
99:59:59,999 --> 99:59:59,999
see that there is some potential.
H: I see someone at microphone number 3,

234
99:59:59,999 --> 99:59:59,999
please. This would be the last question
because we have to hurry a bit.

235
99:59:59,999 --> 99:59:59,999
Q: Can I know a little bit more about the
super charging microwave? I'm confused.

236
99:59:59,999 --> 99:59:59,999
*applause*
[Filler, please remove me in amara]

237
99:59:59,999 --> 99:59:59,999
M: Sure, you can come to our POC desk and
then we answer all your questions.

238
99:59:59,999 --> 99:59:59,999
H: Ooh... mystery.  Please, give the POC a
hand.

239
99:59:59,999 --> 99:59:59,999
So next team, is it from the GSM crew?
Someone there? I think we have two. I see

240
99:59:59,999 --> 99:59:59,999
some Chaos Post, you have to wait one
round. So, GSM guy thank you. I am good

241
99:59:59,999 --> 99:59:59,999
with computers, I think. Yeah, I am. Have
fun. If it's working or not. Look at this

242
99:59:59,999 --> 99:59:59,999
smile then looks better. Try this. Yeah.
Right. Try this.

243
99:59:59,999 --> 99:59:59,999
- 423.
- Maybe you have to use GSM.

244
99:59:59,999 --> 99:59:59,999
- 23 test.
- What happened?

245
99:59:59,999 --> 99:59:59,999
- Hello. Hello.
- Aah.

246
99:59:59,999 --> 99:59:59,999
GSM Person 1: So as every year we ran our
own mobile phone network at the Congress

247
99:59:59,999 --> 99:59:59,999
using osmocom open source software for 2G
and 3G, and open5gs interfacing with the

248
99:59:59,999 --> 99:59:59,999
osmocom HLR. And all you need to take part
is a SIM card that you can buy from the

249
99:59:59,999 --> 99:59:59,999
POC and for 5 euros you get a flat rate.
The price increases because we have less

250
99:59:59,999 --> 99:59:59,999
SIM cards every year. We need to
manufacture new ones. You can even call

251
99:59:59,999 --> 99:59:59,999
outside like you can with DECT phones.
Lynxis: Hello. I'm Lynxis. So as every

252
99:59:59,999 --> 99:59:59,999
year for the GSM team, the first problem
is the license. That's the first step

253
99:59:59,999 --> 99:59:59,999
usually. Because in Germany, you have to
get the official form, get a license but

254
99:59:59,999 --> 99:59:59,999
... Where do you get it? What can you ask
for frequencies? Because, for example, the

255
99:59:59,999 --> 99:59:59,999
POC for DECT or Wi-Fi, you just place it
and you can use it. You're fine.

256
99:59:59,999 --> 99:59:59,999
But for GSM, they didn't think about it or
for 3G or 4G. So yeah, this year we

257
99:59:59,999 --> 99:59:59,999
usually get the license middle of
december, maybe start of december. So it's

258
99:59:59,999 --> 99:59:59,999
already late. So this year we didn't get
all our licenses. But we get some. We got

259
99:59:59,999 --> 99:59:59,999
850 MHz, which is not assigned in Europe
because it's usually in the US only. But

260
99:59:59,999 --> 99:59:59,999
we have a small hole. This year we got a
4G license instead of a 2G license with 10

261
99:59:59,999 --> 99:59:59,999
Mhz from Telefonica. So thanks Telefonica
for borrowing us spectrum.

262
99:59:59,999 --> 99:59:59,999
*applause*
[Filler, please remove me in amara]

263
99:59:59,999 --> 99:59:59,999
L: Just a short example of how the
spectrum looks like. The yellow stuff is

264
99:59:59,999 --> 99:59:59,999
usually somewhere behind actually. By the
way, this microphone, it might share the

265
99:59:59,999 --> 99:59:59,999
same frequency with us. But so far, we
haven't found any interference together

266
99:59:59,999 --> 99:59:59,999
with the VOC. Down there you can see the
small hole which we are using. Because we

267
99:59:59,999 --> 99:59:59,999
didn't get the 2G license there, we
thought, OK. Let's take a look. Can we fit

268
99:59:59,999 --> 99:59:59,999
them both in the same frequencies? It's
not good. But you see the spikes, this

269
99:59:59,999 --> 99:59:59,999
nice antenna on the right. That's the GSM,
which is sending on the same frequency. It

270
99:59:59,999 --> 99:59:59,999
works because they are using different
codings. But I have heard from people who

271
99:59:59,999 --> 99:59:59,999
know more about it, this is not the way
you use it.

272
99:59:59,999 --> 99:59:59,999
*laughing*
[Filler, please remove me in amara]

273
99:59:59,999 --> 99:59:59,999
L: So we took some photos of our base
stations. This is actually the fairy dust

274
99:59:59,999 --> 99:59:59,999
from the 2G base station, so we have a
idea what we are using here. We have even

275
99:59:59,999 --> 99:59:59,999
more fairy dust in our 3G femtocells and
our 4G cells. They are looking like small

276
99:59:59,999 --> 99:59:59,999
toasters. They are taking actually 90
watts via POE, they have special POE

277
99:59:59,999 --> 99:59:59,999
adapters. So maybe we could ask if
somebody can do a similar adapter to get

278
99:59:59,999 --> 99:59:59,999
even running a toaster on the line.
So basically for the 4G setup this year,

279
99:59:59,999 --> 99:59:59,999
we weren't sure if it's stable enough or
we lose all our phones to the LTE and they

280
99:59:59,999 --> 99:59:59,999
don't like to come back to the 2G and 3G
setup where we have voice, because on LTE

281
99:59:59,999 --> 99:59:59,999
we don't have yet voice so you have to
select specifically to join the LTE

282
99:59:59,999 --> 99:59:59,999
network. That worked quite fine if you
change it. So your phone will register.

283
99:59:59,999 --> 99:59:59,999
Everything fine there.
GSM1: So the rollout this year: we had the

284
99:59:59,999 --> 99:59:59,999
voice working on day 0 which is new.
[Filler, please remove me in amara]

285
99:59:59,999 --> 99:59:59,999
*applause*
[Filler, please remove me in amara]

286
99:59:59,999 --> 99:59:59,999
GSM1: Someone even noticed on Mastodon, I
saw it, too. We already had LTE at the CCC

287
99:59:59,999 --> 99:59:59,999
camp this year. Yeah, but unfortunately we
lost crypto password, so LTE roll out took

288
99:59:59,999 --> 99:59:59,999
a bit longer this time. Sorry. So some
numbers. In total we saw just about 1100

289
99:59:59,999 --> 99:59:59,999
people doing a location updating on our
network and 845 eventphone tokens were

290
99:59:59,999 --> 99:59:59,999
dialed on the GSM. That is 2G or 3G. And
there were roughly 200 phones actively

291
99:59:59,999 --> 99:59:59,999
subscribed on the network at all times.
And even though we basically only deployed

292
99:59:59,999 --> 99:59:59,999
3G nano stations in all the halls and only
had two 2G BTS in the glass halle, there

293
99:59:59,999 --> 99:59:59,999
were roughly more than half of all the
phones were still subscribed on 2G instead

294
99:59:59,999 --> 99:59:59,999
of 3G. We had like 18 3G stations and only
two plus one in the GSM room 2G stations.

295
99:59:59,999 --> 99:59:59,999
So that's a bit surprising. And SIM cards:
starting from the bottom, we sold about

296
99:59:59,999 --> 99:59:59,999
700 SIM cards, but only saw half of them
activated, which is curious. And luckily,

297
99:59:59,999 --> 99:59:59,999
most or some people bring old SIM cards
from previous years. And it's not so easy

298
99:59:59,999 --> 99:59:59,999
to get cards manufactured. So we are very
glad for everyone who brings old SIM cards

299
99:59:59,999 --> 99:59:59,999
from previous events. We might even
consider introducing charging phone calls

300
99:59:59,999 --> 99:59:59,999
only for SIM cards that are newly bought.
So if you want to continue calling for

301
99:59:59,999 --> 99:59:59,999
free, rather bring your old SIM cards.
[Filler, please remove me in amara]

302
99:59:59,999 --> 99:59:59,999
*applause*
[Filler, please remove me in amara]

303
99:59:59,999 --> 99:59:59,999
GSM1: So you see the numbers, I'm not
going to go through them. And you can also

304
99:59:59,999 --> 99:59:59,999
get the ADM, the admin keys for your SIM
cards if you like to write to them.

305
99:59:59,999 --> 99:59:59,999
L: Or if you have seen the talk from
LaForge, you might want to play with the

306
99:59:59,999 --> 99:59:59,999
SIM cards, we give out all the keys you
want to have to play with it.

307
99:59:59,999 --> 99:59:59,999
GSM1: So operation was mostly smooth,
except iPhones, for unknown reasons. And

308
99:59:59,999 --> 99:59:59,999
except the data service, which might even
be related because maybe Apple is a bit

309
99:59:59,999 --> 99:59:59,999
more strict on whether data service is
working reliably. Yeah, we still had some

310
99:59:59,999 --> 99:59:59,999
problems in the SGs instance introducing
3G changing between the radio access

311
99:59:59,999 --> 99:59:59,999
technologies. It's a whole new ballgame so
there are still some bugs in there. And as

312
99:59:59,999 --> 99:59:59,999
you see, we had many more tickets than the
POC. This is actually reversed from the

313
99:59:59,999 --> 99:59:59,999
POC, the "done" is on the left. So this
whole bunch of stuff is done and there's

314
99:59:59,999 --> 99:59:59,999
some backlog and canceled and fantasy
tasks. It worked pretty nicely. Are you

315
99:59:59,999 --> 99:59:59,999
taking over? Oh, yeah, no, this is still
mine. And this year we actually had also a

316
99:59:59,999 --> 99:59:59,999
denial of service attack. The code was the
same as previous years and we never saw

317
99:59:59,999 --> 99:59:59,999
this before. But this year we got an
invalid mobile identity which managed to

318
99:59:59,999 --> 99:59:59,999
crash our mobile switching center. And
thank you very much for uncovering this

319
99:59:59,999 --> 99:59:59,999
bug and thanks to fixeria for fixing it on
day 2. Ever since the mobile switching

320
99:59:59,999 --> 99:59:59,999
center for Voice and SMS and subscription
has been running stable.

321
99:59:59,999 --> 99:59:59,999
*applause*
[Filler, please remove me in amara]

322
99:59:59,999 --> 99:59:59,999
L: Maybe some interference. We recovered
the old phones again. Last year we

323
99:59:59,999 --> 99:59:59,999
couldn't support them. But we managed to
implement the missing parts. Old phones

324
99:59:59,999 --> 99:59:59,999
could work if they support the
frequencies. So that's really nice. Maybe

325
99:59:59,999 --> 99:59:59,999
next time. Since camp, we also did a nice
angel helpdesk. And it was really

326
99:59:59,999 --> 99:59:59,999
impressive to see that we even had to add
more shifts in our shifts. We had so many

327
99:59:59,999 --> 99:59:59,999
motivated angels. Thanks to everybody who
helped us, it was really great.

328
99:59:59,999 --> 99:59:59,999
*applause*
[Filler, please remove me in amara]

329
99:59:59,999 --> 99:59:59,999
H: Unfortunately, we don't have enough
time for a Q&A. So please give them a hand

330
99:59:59,999 --> 99:59:59,999
for everything they did.
[Filler, please remove me in amara]

331
99:59:59,999 --> 99:59:59,999
*applause*
[Filler, please remove me in amara]

332
99:59:59,999 --> 99:59:59,999
H: Thank you. There are quite a lot of
teams next. I count at least like eight,

333
99:59:59,999 --> 99:59:59,999
maybe nine. So we need to speed up a bit.
Our next team for now will be... We don't

334
99:59:59,999 --> 99:59:59,999
have working microphones.
Chaos post 1: Sorry, we need to interrupt

335
99:59:59,999 --> 99:59:59,999
you anyway.
H: OK. So tell them, chaos post! Chaos

336
99:59:59,999 --> 99:59:59,999
post!
[Filler, please remove me in amara]

337
99:59:59,999 --> 99:59:59,999
*applause*
[Filler, please remove me in amara]

338
99:59:59,999 --> 99:59:59,999
Chaos post 1: Sorry, guys, we interrupt...
[Filler, please remove me in amara]

339
99:59:59,999 --> 99:59:59,999
H: Let's get rid of the broken one because
it's not working anyway.

340
99:59:59,999 --> 99:59:59,999
Chaos post 1: All right. Sorry, we are
interrupting for a few minutes only. We

341
99:59:59,999 --> 99:59:59,999
would like to deliver a few statistics as
well. So thanks of all, we had multiple

342
99:59:59,999 --> 99:59:59,999
chaos deliverers working throughout the
whole Congress 24/7 basically, delivering

343
99:59:59,999 --> 99:59:59,999
at the speed of chaos, as our mission
statement clearly states. So thank you

344
99:59:59,999 --> 99:59:59,999
therefore, first of all thank you very
much to all of you who contributed to

345
99:59:59,999 --> 99:59:59,999
that.
[Filler, please remove me in amara]

346
99:59:59,999 --> 99:59:59,999
*applause*
[Filler, please remove me in amara]

347
99:59:59,999 --> 99:59:59,999
Chaos post 2: So let's have some numbers,
because you all love numbers, right? So we

348
99:59:59,999 --> 99:59:59,999
delivered about 3000 external postcards.
So that means with like outside chaos, so

349
99:59:59,999 --> 99:59:59,999
to the real world or the default world, as
we call it. We delivered those to over 42

350
99:59:59,999 --> 99:59:59,999
countries all over the world. So you guys
are really good connected internationally.

351
99:59:59,999 --> 99:59:59,999
And also, we don't have exact numbers, but
we estimate around 3500, no, 35000,

352
99:59:59,999 --> 99:59:59,999
internal postcards. And you also use our
online office for a total of 789 times. So

353
99:59:59,999 --> 99:59:59,999
that is only 15 less than camp, and that
was a longer event. So, hey, you guys

354
99:59:59,999 --> 99:59:59,999
write a lot of postcards!
[Filler, please remove me in amara]

355
99:59:59,999 --> 99:59:59,999
*applause*
[Filler, please remove me in amara]

356
99:59:59,999 --> 99:59:59,999
Chaos post 1: As you might already know
from camp, we also do have a few special

357
99:59:59,999 --> 99:59:59,999
services. As already on camp, we had the
serving proposal, basically a pre-

358
99:59:59,999 --> 99:59:59,999
assembled text, you just had to cross what
you want. The postbox certification and of

359
99:59:59,999 --> 99:59:59,999
course, the bi-directional chaos, in
Germany also known as "Einschreiben mit

360
99:59:59,999 --> 99:59:59,999
Rückschein".
H: Wow.

361
99:59:59,999 --> 99:59:59,999
Chaos post 2: And this time we also
offered some new services. We had like

362
99:59:59,999 --> 99:59:59,999
sang telegrams, gesunges Telegram in
Deutsch. We had a forever alone box for

363
99:59:59,999 --> 99:59:59,999
people wanting to write postcards with or
exchange postcards with no idea who to

364
99:59:59,999 --> 99:59:59,999
write it to. We had love letters, so we
had some nice pre-assembled texts and also

365
99:59:59,999 --> 99:59:59,999
a really nice selection of perfumes for
scented postcards. You could write some

366
99:59:59,999 --> 99:59:59,999
secret messages. We had some UV pens and
also we had some, let's say call it

367
99:59:59,999 --> 99:59:59,999
security, or rather temper evidence,
because we had some scratch off stickers

368
99:59:59,999 --> 99:59:59,999
for you. And also we had over 30 new
postcard designs that you could use for

369
99:59:59,999 --> 99:59:59,999
postcards.
[Filler, please remove me in amara]

370
99:59:59,999 --> 99:59:59,999
*applause*
[Filler, please remove me in amara]

371
99:59:59,999 --> 99:59:59,999
Chaos post 1: Short remark for the love
letters and the perfumes. Well, that was

372
99:59:59,999 --> 99:59:59,999
kind of not really thought through. It was
a bit... it was fun sorting them out, and

373
99:59:59,999 --> 99:59:59,999
stamping all of that, smelling all the
perfume all the time.

374
99:59:59,999 --> 99:59:59,999
Chaos post 2: And then brushing your hands
really thoroughly because, well, that

375
99:59:59,999 --> 99:59:59,999
stuff gets on your hands when you do that.
Chaos post 1: Also for UV pens. Just a

376
99:59:59,999 --> 99:59:59,999
little remark. It's not a good idea to use
it for addressing and the message.

377
99:59:59,999 --> 99:59:59,999
*laughing*
[Filler, please remove me in amara]

378
99:59:59,999 --> 99:59:59,999
Chaos post 1: You can take the risk. All
right, then let me close up. We also

379
99:59:59,999 --> 99:59:59,999
supported mail  this year and
we had 130 letters for activists in

380
99:59:59,999 --> 99:59:59,999
prison, which I find really great. I think
that's something we can all support.

381
99:59:59,999 --> 99:59:59,999
Amazing.
[Filler, please remove me in amara]

382
99:59:59,999 --> 99:59:59,999
*applause*
[Filler, please remove me in amara]

383
99:59:59,999 --> 99:59:59,999
So thank you all for this amazing event,
and have some fun for the rest of the

384
99:59:59,999 --> 99:59:59,999
Congress.
[Filler, please remove me in amara]

385
99:59:59,999 --> 99:59:59,999
*applause*
[Filler, please remove me in amara]

386
99:59:59,999 --> 99:59:59,999
H: Chaos post! So the next team is the
VOC. Yes, you can have it. Here, the VOC.

387
99:59:59,999 --> 99:59:59,999
We only have 20 minutes left in total for
every team. So you know what to do.

388
99:59:59,999 --> 99:59:59,999
VOC1: Hurry up. Welcome, guys. So. Yeah.
We don't have as many statistics as usual.

389
99:59:59,999 --> 99:59:59,999
But we have some great stories too. We'll
hurry up. So this year in total, we

390
99:59:59,999 --> 99:59:59,999
covered 10 stages apart from the 5 stages
that we do usually for Congress. We had

391
99:59:59,999 --> 99:59:59,999
streams from the critical decentralisation
cluster, Sendezentrum, Wikipaka WG, Open

392
99:59:59,999 --> 99:59:59,999
Infrastructure Orbit, Chaos West. And in
total, we served 255 hours and 35 minutes

393
99:59:59,999 --> 99:59:59,999
of total talk time. So you know what to do
until the next Congress.

394
99:59:59,999 --> 99:59:59,999
*applause*
[Filler, please remove me in amara]

395
99:59:59,999 --> 99:59:59,999
VOC1: And of course, sustainability was a
big topic during this Congress. So part of

396
99:59:59,999 --> 99:59:59,999
what we have to do is stream reencoding so
you can watch it with the VP5 codec or use

397
99:59:59,999 --> 99:59:59,999
it at lower resolution. And so far we've
been using 4 Xeon-based machines and 2

398
99:59:59,999 --> 99:59:59,999
desktop machines. And thanks to hardware-
based encoding, we now replace this with a

399
99:59:59,999 --> 99:59:59,999
single laptop. As you can maybe read, this
is critical infrastructure now. And for

400
99:59:59,999 --> 99:59:59,999
all the streams, for 30 reencoding
streams, we are on a 45 watt power budget

401
99:59:59,999 --> 99:59:59,999
now. And as an added benefit, because we
also encode the master slides with

402
99:59:59,999 --> 99:59:59,999
hardware encoders, and hardware encoders
can generally use a higher profile that

403
99:59:59,999 --> 99:59:59,999
allows for better quality in real time,
you now get a better picture as well. So,

404
99:59:59,999 --> 99:59:59,999
yeah.
[Filler, please remove me in amara]

405
99:59:59,999 --> 99:59:59,999
*applause*
[Filler, please remove me in amara]

406
99:59:59,999 --> 99:59:59,999
VOC1: And of course, we had some minor
fuckups this year. We thought the audio

407
99:59:59,999 --> 99:59:59,999
setup was a bit less complex. But when we
checked rooms, we had buzzing everywhere.

408
99:59:59,999 --> 99:59:59,999
So we replaced some SDI lines with fiber
and turns out buzzing goes away. Then the

409
99:59:59,999 --> 99:59:59,999
PA sound console had a buggy DANTE card.
After you reboot them, the auxiliary out

410
99:59:59,999 --> 99:59:59,999
to the VOC cameras was muted. So that
messed up the particular talk that has

411
99:59:59,999 --> 99:59:59,999
been redone today, but other than that, we
are rather happy. And we figured that 3 of

412
99:59:59,999 --> 99:59:59,999
our audio mixers actually had broken
outputs. I don't know how we did that, but

413
99:59:59,999 --> 99:59:59,999
it clearly shows that they've been used on
one event or another during the last

414
99:59:59,999 --> 99:59:59,999
years, which is actually a good thing we
may think. On the Wikipaka stage, we did

415
99:59:59,999 --> 99:59:59,999
not use Ansible because there was sort of
a playground for us. But if you don't do

416
99:59:59,999 --> 99:59:59,999
things properly, well, then you run into
edge cases with things. And yeah. So I

417
99:59:59,999 --> 99:59:59,999
need to hurry up. And one virtualization
host suddenly started leaking memory. And

418
99:59:59,999 --> 99:59:59,999
so if you were affected by that during the
main talk season in the evening, we are

419
99:59:59,999 --> 99:59:59,999
very sorry about that. Updating the kernel
helped and we have no idea what happened.

420
99:59:59,999 --> 99:59:59,999
Yeah, and Icecast got stuck as well. And
some relive... so if you want to see talks

421
99:59:59,999 --> 99:59:59,999
later, that may not be possible because we
ran temporarily out of space. But if you

422
99:59:59,999 --> 99:59:59,999
watch this on media.ccc.de, and the talks
were not yet released, we have relive

423
99:59:59,999 --> 99:59:59,999
integration, so the talks show up in
media.ccc.de even though there is no

424
99:59:59,999 --> 99:59:59,999
proper release yet, for your convenience.
And main track and assemblies are now

425
99:59:59,999 --> 99:59:59,999
integrated in all events, so you don't
have to click through 4 separate events to

426
99:59:59,999 --> 99:59:59,999
find your favorite talk. And now I pass to
Pat to talk about VOCTOMIX 2.

427
99:59:59,999 --> 99:59:59,999
Pat: Yeah. Thank you. Okay. I have now 20
seconds, I think. I made a redesign of

428
99:59:59,999 --> 99:59:59,999
VOCTOMIX, it's now called VOC2MIX. And
Peter was doing that meme some weeks ago,

429
99:59:59,999 --> 99:59:59,999
because we had to switch to VOCTOMIX 2 and
we wanted to try it in 2 rooms. And in the

430
99:59:59,999 --> 99:59:59,999
night from day 0 to 1 we decided to do it
for every stage because the old solution

431
99:59:59,999 --> 99:59:59,999
was not working anymore. That was a little
bit hot, but it worked. And, the redesign

432
99:59:59,999 --> 99:59:59,999
caused the new UI, complete with some new
base features. We have now transitions

433
99:59:59,999 --> 99:59:59,999
where pictures are moving, and we have
insertions for blending text into the

434
99:59:59,999 --> 99:59:59,999
picture and we have a new audio mixing and
we are now proper A/V Sync in every case,

435
99:59:59,999 --> 99:59:59,999
I think.
[Filler, please remove me in amara]

436
99:59:59,999 --> 99:59:59,999
*applause*
[Filler, please remove me in amara]

437
99:59:59,999 --> 99:59:59,999
Pat: And some mixer angels were exploring
the software and they found some bonus

438
99:59:59,999 --> 99:59:59,999
features like random video distortion in
some cases, which I have to fix, I think.

439
99:59:59,999 --> 99:59:59,999
And the party mode where you click some
buttons and they are clicking without any

440
99:59:59,999 --> 99:59:59,999
doing of the user and everything is
flickering and they called it party mode.

441
99:59:59,999 --> 99:59:59,999
This is what the current pipeline looks
like. We have now over 200 gstreamer

442
99:59:59,999 --> 99:59:59,999
elements doing all this stuff to get your
pictures, which you are having on the

443
99:59:59,999 --> 99:59:59,999
stream and in the recordings. That's it.
VOC1: So, of course, there were some

444
99:59:59,999 --> 99:59:59,999
issues. I mean VOCTOMIX2 is essentially a
rewrite.

445
99:59:59,999 --> 99:59:59,999
H: You have to speed up a bit. Actually we
are stealing time from the other teams. I

446
99:59:59,999 --> 99:59:59,999
might call it a quit.
VOC1: OK OK OK. So...

447
99:59:59,999 --> 99:59:59,999
H: Pressure!
VOC1: Yes, I know. But you're not making

448
99:59:59,999 --> 99:59:59,999
things better. So one thing to mention: we
had to deploy a sweaty finger fix after

449
99:59:59,999 --> 99:59:59,999
the first talk started. Ok, here are your
stats, read them now,  read them read them

450
99:59:59,999 --> 99:59:59,999
read them!
[Filler, please remove me in amara]

451
99:59:59,999 --> 99:59:59,999
*applause*
[Filler, please remove me in amara]

452
99:59:59,999 --> 99:59:59,999
H: Please give VOC a hand. Thank you. So
what's next? Oh, the Stage manager and

453
99:59:59,999 --> 99:59:59,999
Herald Operation Center. I'm part of it.
And we have 36 heralds, every one of them

454
99:59:59,999 --> 99:59:59,999
very eloquent and good-looking. Then we
have 70 stage managers and stage

455
99:59:59,999 --> 99:59:59,999
supporters. We had 150 shows on official
stages and the assemblies on top of it. We

456
99:59:59,999 --> 99:59:59,999
have one stage fright council yet for the
speakers who took care of at least six

457
99:59:59,999 --> 99:59:59,999
talks. And then we threw away over 100
hosting cards on day 1 only. So clearly,

458
99:59:59,999 --> 99:59:59,999
give a hand for the SHOC.
[Filler, please remove me in amara]

459
99:59:59,999 --> 99:59:59,999
*applause*
[Filler, please remove me in amara]

460
99:59:59,999 --> 99:59:59,999
H: So next, c3power. Your time.
Arif: So my name is Arif Guy. I am from

461
99:59:59,999 --> 99:59:59,999
the power team and from the radio
operation center. We make the power. We

462
99:59:59,999 --> 99:59:59,999
load five double trucks of shit out on
Sunday 15th. We deploy a lot of power

463
99:59:59,999 --> 99:59:59,999
boxes and many cables. So we have teardown
today so every help is needed. We have

464
99:59:59,999 --> 99:59:59,999
only one day to bring us back. The main
thing, we had the power meter that we made

465
99:59:59,999 --> 99:59:59,999
on the camp this year. We have two nice
setup on room H. You see the power factor

466
99:59:59,999 --> 99:59:59,999
is very bad. And the other one was the
Waffle Operation Center so you see they

467
99:59:59,999 --> 99:59:59,999
have a nice power factor. So please use
more ohmic devices like heaters, waffle

468
99:59:59,999 --> 99:59:59,999
iron or something. We only have 5 Seaview
to monitor Yolocolo. You have on

469
99:59:59,999 --> 99:59:59,999
c3power.top a Grafana link that also links
to the main Grafana to the NOC. Another

470
99:59:59,999 --> 99:59:59,999
nice thing we have on the lounge, I have a
video here. It started now. You can see

471
99:59:59,999 --> 99:59:59,999
the current on all 3 phases to the audio
and you can see the audio from the lounge.

472
99:59:59,999 --> 99:59:59,999
*recorded music from the lounge*
[Filler, please remove me in amara]

473
99:59:59,999 --> 99:59:59,999
Arif: It's very nice.
[Filler, please remove me in amara]

474
99:59:59,999 --> 99:59:59,999
*recorded music from the lounge*
[Filler, please remove me in amara]

475
99:59:59,999 --> 99:59:59,999
Arif: As you see, the only thing is...
[Filler, please remove me in amara]

476
99:59:59,999 --> 99:59:59,999
*applause*
[Filler, please remove me in amara]

477
99:59:59,999 --> 99:59:59,999
Arif: Use more bass, or make more current.
Later we can show you another slide. Go to

478
99:59:59,999 --> 99:59:59,999
next slide please. So for the radio team
we have 120 portable radios. We have

479
99:59:59,999 --> 99:59:59,999
updated them to a new firmware, and a new
programming software with a new feature

480
99:59:59,999 --> 99:59:59,999
that is a lot slower than the last
version. Very nice. 50 bring-your-own-

481
99:59:59,999 --> 99:59:59,999
device radios. 5 dead radios from the
camp. 2 dead from 36c3. 2 dead repeaters

482
99:59:59,999 --> 99:59:59,999
from the camp. 1 dead on arrival on this
stage. 3 rental repeaters from 2

483
99:59:59,999 --> 99:59:59,999
companies, one we picked up in Hannover
just before the Congress, and even the

484
99:59:59,999 --> 99:59:59,999
windows PC crashed down dead on arrival.
Business as usual. So, next team!

485
99:59:59,999 --> 99:59:59,999
H: Thank you! So, the next is c3subtitles.
I think it's Amy and Julia. Amy. They are

486
99:59:59,999 --> 99:59:59,999
not. C3SOS. S.O.S. It's you. Okay. Okay.
Sorry. Oh, I'm sorry. Not the subtitles.

487
99:59:59,999 --> 99:59:59,999
It's well, sustainability. Your stage, go
for it. Here, feel free.

488
99:59:59,999 --> 99:59:59,999
Amy: Hello. Okay, hi. My name is Amy, I'm
part of the c3sustainability team. I only

489
99:59:59,999 --> 99:59:59,999
have four slides, so I'll be very quick.
You can see, the first of our biggest

490
99:59:59,999 --> 99:59:59,999
projects was the drinking water
dispensers. So for angels, we had drinking

491
99:59:59,999 --> 99:59:59,999
water from a dispenser rather than from
bottles and they could refill their

492
99:59:59,999 --> 99:59:59,999
bottles. We go through some stats there.
So when we started planning how difficult

493
99:59:59,999 --> 99:59:59,999
it was to implement it, the locations, and
how many volunteers, satisfaction was very

494
99:59:59,999 --> 99:59:59,999
high for this one. So thank you to c3geld
who really helped organize the water

495
99:59:59,999 --> 99:59:59,999
dispensers with us. We're very happy. They
were really great. Please give them a

496
99:59:59,999 --> 99:59:59,999
round of applause.
[Filler, please remove me in amara]

497
99:59:59,999 --> 99:59:59,999
*applause*
[Filler, please remove me in amara]

498
99:59:59,999 --> 99:59:59,999
Amy: Thank you. The next one was a give
and take electronic box. So we wanted to

499
99:59:59,999 --> 99:59:59,999
encourage people not to throw away their
electronics. Of course, they can be

500
99:59:59,999 --> 99:59:59,999
recycled. So we have deployed 10 boxes.
You can find them in the sticker stations.

501
99:59:59,999 --> 99:59:59,999
And we did this in collaboration with the
hardware hacking area. Thank you. And

502
99:59:59,999 --> 99:59:59,999
other assemblies. Oh, wow, you are really
fast.

503
99:59:59,999 --> 99:59:59,999
H: Yes I am.
Amy: Okay!

504
99:59:59,999 --> 99:59:59,999
H: Others are waiting!
Amy: Okay. So the last one I wanted to go

505
99:59:59,999 --> 99:59:59,999
through. We have two initiatives on this
one. I'm sorry for the trashy picture

506
99:59:59,999 --> 99:59:59,999
there. We have organic bins in the halls.
It was very, very difficult to do this.

507
99:59:59,999 --> 99:59:59,999
But actually it was quite satisfactory.
But I would say there is room for

508
99:59:59,999 --> 99:59:59,999
improvement there. And there was also an
initiative for recycling cigaret butts. So

509
99:59:59,999 --> 99:59:59,999
we actually had two people go round,
collect your cigaret butts and they will

510
99:59:59,999 --> 99:59:59,999
be recycled into cool ashtrays. What a
success! Thank you so much to everyone who

511
99:59:59,999 --> 99:59:59,999
collaborated with us. We couldn't do out
without your help.

512
99:59:59,999 --> 99:59:59,999
H: Thank you. Your applause, please.
[Filler, please remove me in amara]

513
99:59:59,999 --> 99:59:59,999
*applause*
[Filler, please remove me in amara]

514
99:59:59,999 --> 99:59:59,999
H: So unfortunately, the c3sign is not
coming. So just take a look at those

515
99:59:59,999 --> 99:59:59,999
pictures while I go through them. And now
the next one is C3 Assemblies. Here, take

516
99:59:59,999 --> 99:59:59,999
this one. Thank you. Be quick.
Pingu: Hi, my name is Pingu. I'm here for

517
99:59:59,999 --> 99:59:59,999
the assembly team. And I just want to ask,
give a hand who hasn't found his assembly

518
99:59:59,999 --> 99:59:59,999
on day zero or day one? So then give a big
applause to c3nav because they really

519
99:59:59,999 --> 99:59:59,999
helped us a lot. Because without them, it
wasn't able to do this event just for us.

520
99:59:59,999 --> 99:59:59,999
Because for some figures we had 419
assemblies to place on this area which is

521
99:59:59,999 --> 99:59:59,999
about 35000 square meters. We had 3000
tables all over, 2500 in the assemblies,

522
99:59:59,999 --> 99:59:59,999
with 6000 chairs. And here, please give a
big applause to the C3Möbelhaus or IKEA as

523
99:59:59,999 --> 99:59:59,999
you call it.
[Filler, please remove me in amara]

524
99:59:59,999 --> 99:59:59,999
*applause*
[Filler, please remove me in amara]

525
99:59:59,999 --> 99:59:59,999
Pingu: Because the Möbelhaus basically
placed all the tables in a magic night on

526
99:59:59,999 --> 99:59:59,999
basically day -2. And they will disappear
with the help of C3Möbelhaus today. We

527
99:59:59,999 --> 99:59:59,999
assigned the last assembly on day zero at
22:00 and we started our work in mid-

528
99:59:59,999 --> 99:59:59,999
October with weekly meetings. And yeah, as
you can see, it was a lot of work and...

529
99:59:59,999 --> 99:59:59,999
Oh.
H: Thank you.

530
99:59:59,999 --> 99:59:59,999
Pingu: Thank you. And just one thing, for
teardown, for tearing down the assemblies,

531
99:59:59,999 --> 99:59:59,999
please stack the chairs on the assembly
but leave every chair and every table on

532
99:59:59,999 --> 99:59:59,999
the assembly, we will get rid of them.
H: Thanks a lot. Your applause. So the

533
99:59:59,999 --> 99:59:59,999
next ones are... Les prochains, ce sont
les gens de c3lingo, voilà, vos tours!

534
99:59:59,999 --> 99:59:59,999
c3lingo 1: Hallo! Schön euch mal (...) Wir
sind übersetzet. (...) 

535
99:59:59,999 --> 99:59:59,999
German>
Oh, sorry. Well, I'm also fine with that.

536
99:59:59,999 --> 99:59:59,999
We translated all the German talks into
English. All the English talks into

537
99:59:59,999 --> 99:59:59,999
German. All in all, fifteen thousand
minutes in seven different target

538
99:59:59,999 --> 99:59:59,999
languages. And here is from the second
language team, who talk all the non-

539
99:59:59,999 --> 99:59:59,999
English and non-German things.
c3lingo 2: Okay. So basically we did have

540
99:59:59,999 --> 99:59:59,999
about 1/3 of the talks were translated to
French. Yeah. You can read the rest. And

541
99:59:59,999 --> 99:59:59,999
we even have currently, exactly, right
now, another one which is translated into

542
99:59:59,999 --> 99:59:59,999
Swabian. So if you want to listen into it.
[Filler, please remove me in amara]

543
99:59:59,999 --> 99:59:59,999
*applause*
[Filler, please remove me in amara]

544
99:59:59,999 --> 99:59:59,999
c3lingo 2: Which means that if you were
listening to a talk, there is 2 chance out

545
99:59:59,999 --> 99:59:59,999
of 3 that it was translated not only once,
but twice. Into either French, Spanish,

546
99:59:59,999 --> 99:59:59,999
Russian, or Polish. One special mention
for the Russian and Polish teams, that was

547
99:59:59,999 --> 99:59:59,999
their first time this year. So one big
round of applause for them, please.

548
99:59:59,999 --> 99:59:59,999
*applause*
[Filler, please remove me in amara]

549
99:59:59,999 --> 99:59:59,999
c3lingo 2: And one more big thank about
for the guys who brought the cough candies

550
99:59:59,999 --> 99:59:59,999
and cough drops in the booth. That's a
lifesaver. Thanks.

551
99:59:59,999 --> 99:59:59,999
H: Thank you. Merci beaucoup. So we have
some heart operation going on here. You

552
99:59:59,999 --> 99:59:59,999
have to switch it or not? Oh, you're good
with computers.

553
99:59:59,999 --> 99:59:59,999
*laughing*
[Filler, please remove me in amara]

554
99:59:59,999 --> 99:59:59,999
H: He just *mimicks something*. So
c3infrastructure from the subtitles. Your

555
99:59:59,999 --> 99:59:59,999
stage. Yeah. My microphone. Ha ha.
td: So, thanks. Just a quick look into the

556
99:59:59,999 --> 99:59:59,999
subtitles. So what do we actually do when
we subtitle a talk? Well, first of all, we

557
99:59:59,999 --> 99:59:59,999
take the video from the C3VOC and put it
through speech recognition just to get a

558
99:59:59,999 --> 99:59:59,999
rough transcript that we can then give to
angels to actually correct, because, well,

559
99:59:59,999 --> 99:59:59,999
machine speech recognition doesn't work so
good at all. And then once we have a

560
99:59:59,999 --> 99:59:59,999
working transcript that humans have looked
at, we put that through auto-timing, which

561
99:59:59,999 --> 99:59:59,999
just takes the transcript and aligns that
with the audio, and that usually works

562
99:59:59,999 --> 99:59:59,999
pretty well. And, well, once that is
finished, then we actually have working

563
99:59:59,999 --> 99:59:59,999
subtitles, but we give them to angels for
another round of review just to fix any

564
99:59:59,999 --> 99:59:59,999
mistakes that got overlooked. And maybe
sometimes the timing needs to be adjusted.

565
99:59:59,999 --> 99:59:59,999
And then, when that is done, well, the
subtitle is released. And actually one of

566
99:59:59,999 --> 99:59:59,999
our angels did a nice chart about all this
process that you can see here. It all

567
99:59:59,999 --> 99:59:59,999
sounds better, so thank you for that.
Well, no presentation without graphs. As

568
99:59:59,999 --> 99:59:59,999
you can see, the important thing is
really: everything goes up and to the

569
99:59:59,999 --> 99:59:59,999
right. On the bottom here we have finished
seconds of transcribed talks. So this is

570
99:59:59,999 --> 99:59:59,999
really completed subtitles here. And it
starts already quite high because it

571
99:59:59,999 --> 99:59:59,999
includes all the Congresses before. Then
we have stuff that has been reviewed in

572
99:59:59,999 --> 99:59:59,999
orange. Stuff that has been timed but not
reviewed yet in yellow. And transcribed

573
99:59:59,999 --> 99:59:59,999
but not yet timed stuff in green. All in
all, we had 144 distinct angels. Yeah, I

574
99:59:59,999 --> 99:59:59,999
need to hurry up. 71% of which took 2
shifts and 10% took 7 or more shifts. So

575
99:59:59,999 --> 99:59:59,999
433 hours of work for 126 hours of
material. And so far we've had 6 releases

576
99:59:59,999 --> 99:59:59,999
from this Congress and then lots of hours
worked. All of these numbers are at least

577
99:59:59,999 --> 99:59:59,999
as high as last year's numbers, so good,
thanks. When you have transcripts, you can

578
99:59:59,999 --> 99:59:59,999
do cool stuff with that. So, for example,
generate word clouds to see what people

579
99:59:59,999 --> 99:59:59,999
like. And this case, people seem to like
people and questions and time, which we

580
99:59:59,999 --> 99:59:59,999
don't have any here. So. Well, how do we
actually keep track of all this

581
99:59:59,999 --> 99:59:59,999
complicated stuff? Well, we use a state-
of-the-art NoSQL lock-free columnar data

582
99:59:59,999 --> 99:59:59,999
store, like many of the other teams also
do. And well, thank you all of our angels

583
99:59:59,999 --> 99:59:59,999
for your hard work. And also thanks for
the Heaven for supporting us. And then,

584
99:59:59,999 --> 99:59:59,999
well, if you if you feel bored between
Congresses, you can still continue to work

585
99:59:59,999 --> 99:59:59,999
on transcripts. You have all the
informations here, these slides will be

586
99:59:59,999 --> 99:59:59,999
online, follow us on Twitter. And thank
you.

587
99:59:59,999 --> 99:59:59,999
*applause*
[Filler, please remove me in amara]

588
99:59:59,999 --> 99:59:59,999
H: Please do your thing again, like your
 thing again, like do *mimicks

589
99:59:59,999 --> 99:59:59,999
something*. Take your laptop.
[Filler, please remove me in amara]

590
99:59:59,999 --> 99:59:59,999
*laughing*
[Filler, please remove me in amara]

591
99:59:59,999 --> 99:59:59,999
H: So this was the last one. I think I
will try my best to do something like this

592
99:59:59,999 --> 99:59:59,999
too. Actually I'm not good with computers,
but I know someone who is and who takes

593
99:59:59,999 --> 99:59:59,999
very great care of everyone of us. So one
of my highlights of every Congress, feel

594
99:59:59,999 --> 99:59:59,999
free, the LOC!
LOC: Hello. I'm the stand-in for LOC. As

595
99:59:59,999 --> 99:59:59,999
with all good projects, they're too busy
for documentation. They're packing. So LOC

596
99:59:59,999 --> 99:59:59,999
doesn't have anything. I'm more of the
Department of Health and Safety again. So

597
99:59:59,999 --> 99:59:59,999
for everyone: we have the message from
CERT that there were no work-related

598
99:59:59,999 --> 99:59:59,999
accidents that caused real harm. The odd
broken Mate bottle maybe. But thank you

599
99:59:59,999 --> 99:59:59,999
for having built a city again safely and
orderly, even with all the chaos. For the

600
99:59:59,999 --> 99:59:59,999
people who are driving, please make sure
that the drugs wear off and that you get

601
99:59:59,999 --> 99:59:59,999
some sleep and for all people riding
along, please keep the guys awake. That

602
99:59:59,999 --> 99:59:59,999
would be greatly appreciated. Go home
safely. Thank you very much.

603
99:59:59,999 --> 99:59:59,999
*applause*
[Filler, please remove me in amara]

604
99:59:59,999 --> 99:59:59,999
H: So. Wow, ah, OK. So I'm very sorry to
have to rush some teams and I'm very sorry

605
99:59:59,999 --> 99:59:59,999
that we don't have any time left. We are 1
minute over and I promised the teardown

606
99:59:59,999 --> 99:59:59,999
crew to not do overtime. So please, please
give all the teams their respect and clap

607
99:59:59,999 --> 99:59:59,999
and tramp as loud as you can for now to
finish!

608
99:59:59,999 --> 99:59:59,999
*standing ovation*
[Filler, please remove me in amara]

609
99:59:59,999 --> 99:59:59,999
H: Everything! They did! For us! We did!
For them! Why are you still sitting? You

610
99:59:59,999 --> 99:59:59,999
have to leave. Thank you. From the
c3infrastructure Review. Goodbye.

611
99:59:59,999 --> 99:59:59,999
Subtitles created by many many volunteers and
the c3subtitles.de team. Join us, and help us!