1
99:59:59,999 --> 99:59:59,999
Today, I talk about FAI.me, which is a
build for images.

2
99:59:59,999 --> 99:59:59,999
First, anybody that never heard anything
about FAI?

3
99:59:59,999 --> 99:59:59,999
Ok

4
99:59:59,999 --> 99:59:59,999
I started this project in 1999.

5
99:59:59,999 --> 99:59:59,999
I'm not sure…

6
99:59:59,999 --> 99:59:59,999
No, I'm sure that during those times, the
Debian installer did not have

7
99:59:59,999 --> 99:59:59,999
the preseeding stuff, so we needed
something automatically.

8
99:59:59,999 --> 99:59:59,999
I installed the first cluster with FAI and
I always do talks on FAI or

9
99:59:59,999 --> 99:59:59,999
today in the lightning talks, I talk
a little bit about dracut,

10
99:59:59,999 --> 99:59:59,999
which is used in FAI.

11
99:59:59,999 --> 99:59:59,999
So, what was the motivation.

12
99:59:59,999 --> 99:59:59,999
A neighbour of mine, she came to me with

13
99:59:59,999 --> 99:59:59,999
"My Windows desktop is broken,
can you reinstall it?"

14
99:59:59,999 --> 99:59:59,999
And in the end, I installed her Linux,
and I was shortly thinking about

15
99:59:59,999 --> 99:59:59,999
"Should I use FAI for installing her
desktop with Linux?"

16
99:59:59,999 --> 99:59:59,999
And in the end, I did not use it because
FAI is too complicated,

17
99:59:59,999 --> 99:59:59,999
like the Debian installer, I guess it's
not really that easy for beginners

18
99:59:59,999 --> 99:59:59,999
because there are a lot of questions

19
99:59:59,999 --> 99:59:59,999
but also FAI is not really for beginners.

20
99:59:59,999 --> 99:59:59,999
So this was the motivation about thinking
about FAI.

21
99:59:59,999 --> 99:59:59,999
The target group was always advanced
sysadmins

22
99:59:59,999 --> 99:59:59,999
but I thought maybe it's possible to make
FAI usable also for people

23
99:59:59,999 --> 99:59:59,999
that are not that advanced sysadmins.

24
99:59:59,999 --> 99:59:59,999
The idea is that an installer should cover
most installations.

25
99:59:59,999 --> 99:59:59,999
The Debian installer is really perfect
because I think it covers

26
99:59:59,999 --> 99:59:59,999
all different kinds and strange environments

27
99:59:59,999 --> 99:59:59,999
You can do a lot of things, you can configure
very strange combination of language,

28
99:59:59,999 --> 99:59:59,999
keyboard layout and so on

29
99:59:59,999 --> 99:59:59,999
but I was thinking about an installer
that covers 90 or 95% of the installations

30
99:59:59,999 --> 99:59:59,999
A lot of special cases can be ignored and
since the Debian installer has like

31
99:59:59,999 --> 99:59:59,999
more than 20 questions, I thought it would
be much nicer if there were only

32
99:59:59,999 --> 99:59:59,999
3 to 5 questions and I looked at Linux Mint
and Mageia installers, CentOS installer,

33
99:59:59,999 --> 99:59:59,999
and they all ask much less questions.

34
99:59:59,999 --> 99:59:59,999
In the Debian installer, we sometimes
have also things that are asked

35
99:59:59,999 --> 99:59:59,999
during the installation, so not everything
is asked at the very beginning.

36
99:59:59,999 --> 99:59:59,999
For example, the task selection, where you
select your desktop,

37
99:59:59,999 --> 99:59:59,999
is done after the base installation.

38
99:59:59,999 --> 99:59:59,999
This was also very important, I would like
to have something that

39
99:59:59,999 --> 99:59:59,999
asks everything at the very beginning.

40
99:59:59,999 --> 99:59:59,999
Then, maybe some tool could create
a customized installation image

41
99:59:59,999 --> 99:59:59,999
and this installation image should run
then completely unattended

42
99:59:59,999 --> 99:59:59,999
so you can get yourself a coffee and
when you come back, your machine is ready.

43
99:59:59,999 --> 99:59:59,999
There are 3 things to customize installation
image,

44
99:59:59,999 --> 99:59:59,999
you just put this image, you do not have
to touch anything, and then it's ready.

45
99:59:59,999 --> 99:59:59,999
I thought "Oh yes, this is FAI, maybe
FAI can do this."

46
99:59:59,999 --> 99:59:59,999
As I said, FAI is only, or was until now
only a tool for experienced sysadmins

47
99:59:59,999 --> 99:59:59,999
and you have to adjust several config
files, these are ASCII files

48
99:59:59,999 --> 99:59:59,999
but still you have to touch 5 to 10
config files to make a customization.

49
99:59:59,999 --> 99:59:59,999
So, how can I make FAI usable for
beginners?

50
99:59:59,999 --> 99:59:59,999
That's the beginning of FAI.me.

51
99:59:59,999 --> 99:59:59,999
There's a web page, we'll show it
in more detail later,

52
99:59:59,999 --> 99:59:59,999
where you can just click some things, and
then you get a customized image.

53
99:59:59,999 --> 99:59:59,999
This image can be put onto a CD, DVD or
USB stick, just with dd

54
99:59:59,999 --> 99:59:59,999
and the customization is just by using
the web interface

55
99:59:59,999 --> 99:59:59,999
so there's no need for you to edit
a text file, a config file inside FAI.

56
99:59:59,999 --> 99:59:59,999
I hope I covered most important thangs
that you want to adjust

57
99:59:59,999 --> 99:59:59,999
or a little bit customize.

58
99:59:59,999 --> 99:59:59,999
You can add additional packages, I think
that's the most important thing

59
99:59:59,999 --> 99:59:59,999
that people say "I want to have the normal
Debian installation

60
99:59:59,999 --> 99:59:59,999
but with some additional packages."

61
99:59:59,999 --> 99:59:59,999
And you can select different different
distributions, so it's not only

62
99:59:59,999 --> 99:59:59,999
the installation image for the stable
release, you can create

63
99:59:59,999 --> 99:59:59,999
3 variants of the installation.

64
99:59:59,999 --> 99:59:59,999
This is the web page and thanks to Juri,
he did a great job

65
99:59:59,999 --> 99:59:59,999
during the first and second day, he added
a new feature that we now have

66
99:59:59,999 --> 99:59:59,999
a toggle button.

67
99:59:59,999 --> 99:59:59,999
Is it big enough or should I zoom in?

68
99:59:59,999 --> 99:59:59,999
Ok.

69
99:59:59,999 --> 99:59:59,999
So, we have a toggle button, what you see
now is just the bare minimum or questions

70
99:59:59,999 --> 99:59:59,999
and we can toggle it to more advanced
settings.

71
99:59:59,999 --> 99:59:59,999
You have to select or just leave this as
it is, username,

72
99:59:59,999 --> 99:59:59,999
if you do not enter a password, a password
will be generated and shown to you

73
99:59:59,999 --> 99:59:59,999
and sent by e-mail.

74
99:59:59,999 --> 99:59:59,999
I will now just type in the password.

75
99:59:59,999 --> 99:59:59,999
It's here in clear text, for me that's fine
because

76
99:59:59,999 --> 99:59:59,999
there's also a comment that you should
change the password after the installation

77
99:59:59,999 --> 99:59:59,999
and I do not like to enter passwords twice
so you can see what you typed in

78
99:59:59,999 --> 99:59:59,999
and hopefully do not make any wrong
mistakes.

79
99:59:59,999 --> 99:59:59,999
For example, we could select the Stretch
distribution with backports,

80
99:59:59,999 --> 99:59:59,999
so we will get a 4.15 kernel with Stretch.

81
99:59:59,999 --> 99:59:59,999
There are some buttons we can say we want
to have some Debian developer tools.

82
99:59:59,999 --> 99:59:59,999
This is what I defined in the FAI
configuration, so just a list of packages.

83
99:59:59,999 --> 99:59:59,999
Here, you can enter you own packages.


84
99:59:59,999 --> 99:59:59,999
I will select the desktop.

85
99:59:59,999 --> 99:59:59,999
You can have an installation without any
desktop, so a very small installation.

86
99:59:59,999 --> 99:59:59,999
I will select the XFCE desktop, but all
the other desktops are here.

87
99:59:59,999 --> 99:59:59,999
The language, these are just task packages
that are…

88
99:59:59,999 --> 99:59:59,999
I think Debian has much more task packages,
I just searched which are

89
99:59:59,999 --> 99:59:59,999
the most common languages, and what I do
if I say I want the spanish language,

90
99:59:59,999 --> 99:59:59,999
also the keyboard layout is spanish.

91
99:59:59,999 --> 99:59:59,999
I know there are different combinations
and with local time,

92
99:59:59,999 --> 99:59:59,999
it's getting more difficult.

93
99:59:59,999 --> 99:59:59,999
This installation will install the clock
with UTC, so if you want to set

94
99:59:59,999 --> 99:59:59,999
your time, you have to do this manually.

95
99:59:59,999 --> 99:59:59,999
I want to cover the most common installations.

96
99:59:59,999 --> 99:59:59,999
We select english US, the desktop and,
as an example, the midnight commander

97
99:59:59,999 --> 99:59:59,999
and GIMP.

98
99:59:59,999 --> 99:59:59,999
I can add an email address so if it would
take longer,

99
99:59:59,999 --> 99:59:59,999
for example if this service will have
success and a lot of people are using it,

100
99:59:59,999 --> 99:59:59,999
you may wait for some minutes so your job
will be finished.

101
99:59:59,999 --> 99:59:59,999
So here are the comments, how to reconfigure
the keyboard or the timezone

102
99:59:59,999 --> 99:59:59,999
and then you just click "Create
the installation image".

103
99:59:59,999 --> 99:59:59,999
Now, in the background, there's some job,
a script, looking "Oh, there's a new job"

104
99:59:59,999 --> 99:59:59,999
and there's a summary of the configuration,
of the web configuration.

105
99:59:59,999 --> 99:59:59,999
Down here you see these are the
FAI classes,

106
99:59:59,999 --> 99:59:59,999
I will explain a little bit more about this.

107
99:59:59,999 --> 99:59:59,999
But with this information, FAI configuration
is generated,

108
99:59:59,999 --> 99:59:59,999
that's what normally the experienced
sysadmins have to create

109
99:59:59,999 --> 99:59:59,999
but here you just click on some buttons
and it will be done for you.

110
99:59:59,999 --> 99:59:59,999
In the meantime, we have some more
advanced features

111
99:59:59,999 --> 99:59:59,999
which I will also show you later.

112
99:59:59,999 --> 99:59:59,999
For example, this very simple installation
just creates one partition

113
99:59:59,999 --> 99:59:59,999
but you can also select that you want
to have a separate /home partition

114
99:59:59,999 --> 99:59:59,999
or using lvm just by selecting this
on the web interface.

115
99:59:59,999 --> 99:59:59,999
You can also add your SSH public key
for logging as root without a password

116
99:59:59,999 --> 99:59:59,999
or what's very nice, I found the new
Ubuntu installer does this,

117
99:59:59,999 --> 99:59:59,999
you can give your github account and
then there's a comment which

118
99:59:59,999 --> 99:59:59,999
receives the public key from your
github account and puts it

119
99:59:59,999 --> 99:59:59,999
into the root account so you can log in
without password.

120
99:59:59,999 --> 99:59:59,999
I think that's very neat.

121
99:59:59,999 --> 99:59:59,999
And if you have a repository with your own
packages, you could also add this and say

122
99:59:59,999 --> 99:59:59,999
"Please install those packages from
my publicly available repository."

123
99:59:59,999 --> 99:59:59,999
Let's see.

124
99:59:59,999 --> 99:59:59,999
As we see, this job finished in 74 seconds.

125
99:59:59,999 --> 99:59:59,999
Now, this customised installation image
is available for download.

126
99:59:59,999 --> 99:59:59,999
You can also download the log file.

127
99:59:59,999 --> 99:59:59,999
Since this is an installation image,
I first have to create

128
99:59:59,999 --> 99:59:59,999
a partial package mirror.

129
99:59:59,999 --> 99:59:59,999
This is done by the command 'fai-mirror'
and you can also read the log of

130
99:59:59,999 --> 99:59:59,999
this call of the fai-mirror, where a list
of all you packages with all the dependencies

131
99:59:59,999 --> 99:59:59,999
are available.

132
99:59:59,999 --> 99:59:59,999
So you see, these are the list of packages
and later they are downloaded

133
99:59:59,999 --> 99:59:59,999
and in the end, it says it created a mirror
of 1G of packages

134
99:59:59,999 --> 99:59:59,999
and since I have a local mirror,
it's very fast.

135
99:59:59,999 --> 99:59:59,999
This is the one part on the installation
image partial mirror with all the packages

136
99:59:59,999 --> 99:59:59,999
and the other is that the config space
which you can also download.

137
99:59:59,999 --> 99:59:59,999
So this is the config space that was
really created for you

138
99:59:59,999 --> 99:59:59,999
by clicking the web interface.

139
99:59:59,999 --> 99:59:59,999
If you want to do more things with FAI,
you can set up your own FAI server

140
99:59:59,999 --> 99:59:59,999
and use this configuration space.

141
99:59:59,999 --> 99:59:59,999
And, that's also very new, the two commands
that are used for creating this ISO image

142
99:59:59,999 --> 99:59:59,999
are now also listed there.

143
99:59:59,999 --> 99:59:59,999
First, create the partial mirror and then
create the installation image.

144
99:59:59,999 --> 99:59:59,999
Ok, copy link location…

145
99:59:59,999 --> 99:59:59,999
Let's see how good the network is here.

146
99:59:59,999 --> 99:59:59,999
[Q] It's a rather large image.

147
99:59:59,999 --> 99:59:59,999
Yeah, because it includes all the packages
and with Xfce, LibreOffice and so on

148
99:59:59,999 --> 99:59:59,999
and the installation environment is maybe
about 200MB.

149
99:59:59,999 --> 99:59:59,999
That's not much bigger than the Debian
installer that you need to download.

150
99:59:59,999 --> 99:59:59,999
So, 2, 1, done.

151
99:59:59,999 --> 99:59:59,999
I have a little wrapper which calls
a fresh kvm machine

152
99:59:59,999 --> 99:59:59,999
with an empty disk and boots this ISO image

153
99:59:59,999 --> 99:59:59,999
and then we will see how this installation
runs.

154
99:59:59,999 --> 99:59:59,999
So this is dracut booting the image

155
99:59:59,999 --> 99:59:59,999
and now you see there are already
some parted commands executed

156
99:59:59,999 --> 99:59:59,999
and now the packages are installed
and everything runs on

157
99:59:59,999 --> 99:59:59,999
and in the end some customization
script.

158
99:59:59,999 --> 99:59:59,999
We use only shell scripts for doing
some customizations

159
99:59:59,999 --> 99:59:59,999
and you see the files are downloaded
from /media/mirror

160
99:59:59,999 --> 99:59:59,999
so this is local on the ISO image.

161
99:59:59,999 --> 99:59:59,999
It would also be possible to create
an image without the packages

162
99:59:59,999 --> 99:59:59,999
and then give another sources.list file
so the packages would be downloaded

163
99:59:59,999 --> 99:59:59,999
from the internet but this default
in the FAI service,

164
99:59:59,999 --> 99:59:59,999
we put everything onto the ISO image.

165
99:59:59,999 --> 99:59:59,999
I guess it will run for 4 minutes.

166
99:59:59,999 --> 99:59:59,999
[Q] ???

167
99:59:59,999 --> 99:59:59,999
Yeah.

168
99:59:59,999 --> 99:59:59,999
What I will show you now is…

169
99:59:59,999 --> 99:59:59,999
So, this was the simple one, now I toggle
this web page and

170
99:59:59,999 --> 99:59:59,999
you will see that there are some more
questions you may answer,

171
99:59:59,999 --> 99:59:59,999
for example you can give a root password.

172
99:59:59,999 --> 99:59:59,999
If you leave this empty, sudo will be
configured.

173
99:59:59,999 --> 99:59:59,999
Here you can upload the SSH key or give
you Github account,

174
99:59:59,999 --> 99:59:59,999
that would be Mrfai for me.

175
99:59:59,999 --> 99:59:59,999
With the partitioning schemes, we have
one partition

176
99:59:59,999 --> 99:59:59,999
or one partition and /home separated
or these two versions with LVM.

177
99:59:59,999 --> 99:59:59,999
FAI itself can do much more, we could do
soft raid set ups, cryptsetup

178
99:59:59,999 --> 99:59:59,999
but here I want to cover the most common
installation, so very simple

179
99:59:59,999 --> 99:59:59,999
we have only 4 things that you can choose.

180
99:59:59,999 --> 99:59:59,999
[Q] For encryption?

181
99:59:59,999 --> 99:59:59,999
[A] Yes.

182
99:59:59,999 --> 99:59:59,999
So, this was the partitioning things.

183
99:59:59,999 --> 99:59:59,999
This is the new feature where you can add
an URL for your local package repository

184
99:59:59,999 --> 99:59:59,999
and the rest is the same, you can add
packages you like, your email address

185
99:59:59,999 --> 99:59:59,999
and then also create an installation image.

186
99:59:59,999 --> 99:59:59,999
I normally set by default, I include
the nonfree linux firmware.

187
99:59:59,999 --> 99:59:59,999
This is because my target audience is
an end user and I want to make it

188
99:59:59,999 --> 99:59:59,999
very comfortable for them, so yeah,
they can just install it

189
99:59:59,999 --> 99:59:59,999
and do not have these problems.

190
99:59:59,999 --> 99:59:59,999
And since this is not on an officiel
debian.org web site,

191
99:59:59,999 --> 99:59:59,999
I can do this with this default.

192
99:59:59,999 --> 99:59:59,999
Let's see, the installation is still running.

193
99:59:59,999 --> 99:59:59,999
So, advanced features.

194
99:59:59,999 --> 99:59:59,999
The next thing after this installation,

195
99:59:59,999 --> 99:59:59,999
I will show you how to create cloud
images.

196
99:59:59,999 --> 99:59:59,999
Currently, we create an installation image,

197
99:59:59,999 --> 99:59:59,999
when you boot it, the installation is run
fully automatically.

198
99:59:59,999 --> 99:59:59,999
The other type of service FAI.me gives
to you is that it creates a raw image

199
99:59:59,999 --> 99:59:59,999
or some other formats as you see here,
qcow2 and whatever

200
99:59:59,999 --> 99:59:59,999
which you can just boot and
the installation is already done.

201
99:59:59,999 --> 99:59:59,999
But first, see if the installation finish.

202
99:59:59,999 --> 99:59:59,999
Ah! Ok.

203
99:59:59,999 --> 99:59:59,999
These are now the shell scripts that are
executed for the customization

204
99:59:59,999 --> 99:59:59,999
of like /etc/messages of today,
/etc/network/interfaces is written

205
99:59:59,999 --> 99:59:59,999
and so on.

206
99:59:59,999 --> 99:59:59,999
You see the installation took 236s, it says
there are some errors

207
99:59:59,999 --> 99:59:59,999
but that's not really true.

208
99:59:59,999 --> 99:59:59,999
And it stops here, but we can also
disable this, this is only for showing

209
99:59:59,999 --> 99:59:59,999
everything went well

210
99:59:59,999 --> 99:59:59,999
and now we just reboot the machine.

211
99:59:59,999 --> 99:59:59,999
You see the grub.

212
99:59:59,999 --> 99:59:59,999
Ok, Xfce desktop.

213
99:59:59,999 --> 99:59:59,999
debian was a user with password FAI.

214
99:59:59,999 --> 99:59:59,999
We have "uname -a", this is 4.16,
the backports kernel was installed there.

215
99:59:59,999 --> 99:59:59,999
We have only one partition, no LVM

216
99:59:59,999 --> 99:59:59,999
and I told it to install gimp which is
not installed by default.

217
99:59:59,999 --> 99:59:59,999
Gimp is there, so this is nice.

218
99:59:59,999 --> 99:59:59,999
And the midnight commander is also there.

219
99:59:59,999 --> 99:59:59,999
And now we just throw this machine.
Gone.

220
99:59:59,999 --> 99:59:59,999
What's very nice with this wrapper script,
it creates the local disk

221
99:59:59,999 --> 99:59:59,999
of the virtual machine in /tmp which is
a RAM disk and I love RAM,

222
99:59:59,999 --> 99:59:59,999
it's so nice and fast.

223
99:59:59,999 --> 99:59:59,999
So, this was installation image and now we
look at the cloud image.

224
99:59:59,999 --> 99:59:59,999
First, you can say how big should your
disk image be.

225
99:59:59,999 --> 99:59:59,999
Here, I say 8GB, you will see it's not
an 8GB image

226
99:59:59,999 --> 99:59:59,999
that you have to download later.

227
99:59:59,999 --> 99:59:59,999
By default, I use zstd compression.

228
99:59:59,999 --> 99:59:59,999
Anyone who dose not know
this compression?

229
99:59:59,999 --> 99:59:59,999
This is very fast, very new, created
by Facebook if I'm correct.

230
99:59:59,999 --> 99:59:59,999
It's for very big files and what you should
never use is gzip with sparse images.

231
99:59:59,999 --> 99:59:59,999
The disk image is sparse and gzip
cannot handle this

232
99:59:59,999 --> 99:59:59,999
so if you compress it and uncompress it
it will be very large

233
99:59:59,999 --> 99:59:59,999
and all the other, xz, zstd, can handle
sparse files very nicely.

234
99:59:59,999 --> 99:59:59,999
So, the hostname is set, the root password,
username with a password.

235
99:59:59,999 --> 99:59:59,999
Now we want to install Buster.

236
99:59:59,999 --> 99:59:59,999
Maybe with no…

237
99:59:59,999 --> 99:59:59,999
Oh, we also do the Xfce desktop.

238
99:59:59,999 --> 99:59:59,999
Any packages you'd like to have in this
cloud image.

239
99:59:59,999 --> 99:59:59,999
"desktop" and "cloud" image does not
make that much sense, maybe.

240
99:59:59,999 --> 99:59:59,999
Emacs25, ok.

241
99:59:59,999 --> 99:59:59,999
And now "Create disk image".

242
99:59:59,999 --> 99:59:59,999
This will take a little bit longer because
we are doing the installation

243
99:59:59,999 --> 99:59:59,999
inside a file image.

244
99:59:59,999 --> 99:59:59,999
But no problem, I can tell you what
other ideas I have.

245
99:59:59,999 --> 99:59:59,999
So, currently we have the installation and
the cloud or virtual machine images for amd64

246
99:59:59,999 --> 99:59:59,999
FAI itself can also do cross-architecture
images so it would be some work

247
99:59:59,999 --> 99:59:59,999
to extend the web page to say
"Please create an arm64 image"

248
99:59:59,999 --> 99:59:59,999
It would be very nice to have predefined
configs for raspberry pi or

249
99:59:59,999 --> 99:59:59,999
all the very different boards

250
99:59:59,999 --> 99:59:59,999
but that would also be possible.

251
99:59:59,999 --> 99:59:59,999
I guess the next thing I will implement
is other distributions

252
99:59:59,999 --> 99:59:59,999
because I know people are always asking it.

253
99:59:59,999 --> 99:59:59,999
Not you but the Ubuntu guys.

254
99:59:59,999 --> 99:59:59,999
Yesterday I did the first test with Ubuntu
bionic, the LTS release

255
99:59:59,999 --> 99:59:59,999
and FAI just works out of the box with it.

256
99:59:59,999 --> 99:59:59,999
So what I have to do is to integrate it
in these FAI.me processing scripts.

257
99:59:59,999 --> 99:59:59,999
Ready-to-go cloud images for the big
cloud providers.

258
99:59:59,999 --> 99:59:59,999
That's only a different FAI config space
that I have to use.

259
99:59:59,999 --> 99:59:59,999
Currently, for example, in what I call
cloud images, I do not install

260
99:59:59,999 --> 99:59:59,999
the package cloud image.

261
99:59:59,999 --> 99:59:59,999
That's needed for all the ones.

262
99:59:59,999 --> 99:59:59,999
I'm also working in the Debian cloud team
and this team decided 2 years ago

263
99:59:59,999 --> 99:59:59,999
that the tool chain in the future for
the official Debian package will be FAI.

264
99:59:59,999 --> 99:59:59,999
Amazon is already using it, so if you
boot or if you use a Debian cloud image

265
99:59:59,999 --> 99:59:59,999
in Amazon, Noah Meyerhans did this and
he's using the FAI tool chain for it.

266
99:59:59,999 --> 99:59:59,999
Google is not yet using because there was
a very small problem

267
99:59:59,999 --> 99:59:59,999
in a config file we had one space too much

268
99:59:59,999 --> 99:59:59,999
which caused grub to hang forever

269
99:59:59,999 --> 99:59:59,999
and that was the reason why they decided
for Stretch to use their auto tool chain.

270
99:59:59,999 --> 99:59:59,999
But the things are working so we have
the config space also for Google.

271
99:59:59,999 --> 99:59:59,999
And also for Azure, some people from
Credativ did this.

272
99:59:59,999 --> 99:59:59,999
The Debian cloud team already has
the FAI configuration for

273
99:59:59,999 --> 99:59:59,999
the big tool providers,
cloud providers.

274
99:59:59,999 --> 99:59:59,999
We could also think on a more generic
FAI installation image.

275
99:59:59,999 --> 99:59:59,999
It's an image that you would boot up
and then enter your job id of the web page

276
99:59:59,999 --> 99:59:59,999
and then the configuration would be
downloaded

277
99:59:59,999 --> 99:59:59,999
and the packages would be just
received from the internet.

278
99:59:59,999 --> 99:59:59,999
That was one…

279
99:59:59,999 --> 99:59:59,999
So, the image would be much smaller
because the packages do not need to be

280
99:59:59,999 --> 99:59:59,999
on the installation image.

281
99:59:59,999 --> 99:59:59,999
It's also possible to create live images
with FAI.

282
99:59:59,999 --> 99:59:59,999
It is a little bit more…

283
99:59:59,999 --> 99:59:59,999
Currently, you need some manual work
but that should be also possible

284
99:59:59,999 --> 99:59:59,999
to use FAI for creating live image
and then also to provide this

285
99:59:59,999 --> 99:59:59,999
on the FAI.me web service.

286
99:59:59,999 --> 99:59:59,999
If you want to customize much more
inside the image, you just say

287
99:59:59,999 --> 99:59:59,999
"Oh, I have some ansible scripts that
I want to execute at the very end"

288
99:59:59,999 --> 99:59:59,999
then I say "Ok, this is just a starting
point, use the FAI.me service

289
99:59:59,999 --> 99:59:59,999
and if you're happy with the FAI tools,
then set up your own FAI server,

290
99:59:59,999 --> 99:59:59,999
create your own configuration space
and then you can do all the crazy things."

291
99:59:59,999 --> 99:59:59,999
So, how does FAI.me work internally.

292
99:59:59,999 --> 99:59:59,999
We have a web server where there are
some CGI scripts and

293
99:59:59,999 --> 99:59:59,999
this is not the build server, so on the
web server, you click "Submit"

294
99:59:59,999 --> 99:59:59,999
"Create my image", all the input
is validated so you cannot make nasty things

295
99:59:59,999 --> 99:59:59,999
and then the CGI writes or creates
a subdirectory and puts files in it,

296
99:59:59,999 --> 99:59:59,999
a config and a meta file

297
99:59:59,999 --> 99:59:59,999
and writes a status
"waiting for processing".

298
99:59:59,999 --> 99:59:59,999
Then, the other server, the build server
reads this config and

299
99:59:59,999 --> 99:59:59,999
this is just an NFS mounted directory,
and sees

300
99:59:59,999 --> 99:59:59,999
"Oh there's a new job I have to process".

301
99:59:59,999 --> 99:59:59,999
In this processing script we pass for
some errors.

302
99:59:59,999 --> 99:59:59,999
What's happening very often that people
type in a package that's not available

303
99:59:59,999 --> 99:59:59,999
and this will be detected and then a new
version of the web page will pop up and say

304
99:59:59,999 --> 99:59:59,999
"Oh, when creating the package mirror,
there was an error

305
99:59:59,999 --> 99:59:59,999
because this package was not known."

306
99:59:59,999 --> 99:59:59,999
Sometimes I have to…

307
99:59:59,999 --> 99:59:59,999
Every night, I create new nfsroots
for Buster.

308
99:59:59,999 --> 99:59:59,999
If there are security updates, I have
to create new nfsroots

309
99:59:59,999 --> 99:59:59,999
for Stretch and backports.

310
99:59:59,999 --> 99:59:59,999
I have some cleanup, so if a lot of jobs
are created,

311
99:59:59,999 --> 99:59:59,999
the images are on the disk after,

312
99:59:59,999 --> 99:59:59,999
normally I say after one day I just
remove the images

313
99:59:59,999 --> 99:59:59,999
so you have one day to download
the images.

314
99:59:59,999 --> 99:59:59,999
There's 3 different configurations

315
99:59:59,999 --> 99:59:59,999
/etc/fai-stretch, /etc/buster,
/etc/fai-stretch-bpo (backports)

316
99:59:59,999 --> 99:59:59,999
We need for the installation image

317
99:59:59,999 --> 99:59:59,999
We need a different nfsroot, but
the config space that is shared

318
99:59:59,999 --> 99:59:59,999
about all configurations,

319
99:59:59,999 --> 99:59:59,999
so it doesn't matter if I install

320
99:59:59,999 --> 99:59:59,999
Stretch or Stretch backports or
Buster,

321
99:59:59,999 --> 99:59:59,999
I can use the same FAI configuration.

322
99:59:59,999 --> 99:59:59,999
Also, for building the cloud images,
I use the same FAI configuration.

323
99:59:59,999 --> 99:59:59,999
A new job is detected, then a copy of
the configuration space will be made

324
99:59:59,999 --> 99:59:59,999
and it will be customized a little bit.

325
99:59:59,999 --> 99:59:59,999
So there are a very very few changes,

326
99:59:59,999 --> 99:59:59,999
for example I have to put the SSH key
into your customized configuration space

327
99:59:59,999 --> 99:59:59,999
or the list of packages or the user and
root password.

328
99:59:59,999 --> 99:59:59,999
Then we have two things, if we want to
create the installation image,

329
99:59:59,999 --> 99:59:59,999
I first have to create the partial package
mirror and then create the installation image

330
99:59:59,999 --> 99:59:59,999
For the cloud images, we do not need
the nfsroot, we just need

331
99:59:59,999 --> 99:59:59,999
the configuration space which is
customized a little bit

332
99:59:59,999 --> 99:59:59,999
and then we can just create the disk image

333
99:59:59,999 --> 99:59:59,999
so there's one step less compared to
creating the installation ISO.

334
99:59:59,999 --> 99:59:59,999
The status on the web page will be
updated, log files written

335
99:59:59,999 --> 99:59:59,999
and if the user said "Please send me
an email if my job is ready",

336
99:59:59,999 --> 99:59:59,999
this will also be sent to the user.

337
99:59:59,999 --> 99:59:59,999
The we have the ISO or the disk image
and this will be copied back

338
99:59:59,999 --> 99:59:59,999
to the web server where the user can then
download it.

339
99:59:59,999 --> 99:59:59,999
And since I have a lot of RAM
in this machine,

340
99:59:59,999 --> 99:59:59,999
everything is run in RAM, very very nice.

341
99:59:59,999 --> 99:59:59,999
As I said, we need an nfsroot,
a configuration space and FAI classes.

342
99:59:59,999 --> 99:59:59,999
This is a very central component in FAI

343
99:59:59,999 --> 99:59:59,999
and this is just a list of names.

344
99:59:59,999 --> 99:59:59,999
So in HOME_LVM, this is the class name,
the FAI class we describe

345
99:59:59,999 --> 99:59:59,999
and I think this is that example:

346
99:59:59,999 --> 99:59:59,999
HOME_LVM describes how to partition
the local hard disk.

347
99:59:59,999 --> 99:59:59,999
This is our very flexible tool where
we can do LVM, cryptsetups,

348
99:59:59,999 --> 99:59:59,999
software RAIDs and so on.

349
99:59:59,999 --> 99:59:59,999
But for the FAI.me service, I just created
4 different types of partitioning

350
99:59:59,999 --> 99:59:59,999
and this is the HOME_LVM example.

351
99:59:59,999 --> 99:59:59,999
So we have a list of classes and,
as I said,

352
99:59:59,999 --> 99:59:59,999
just two commands for the installation
image with a list of classes

353
99:59:59,999 --> 99:59:59,999
and for the cloud image, I have to say
how big should the disk image be,

354
99:59:59,999 --> 99:59:59,999
the list of classes and what's the target
file that should be created.

355
99:59:59,999 --> 99:59:59,999
Let's see if this is ready.

356
99:59:59,999 --> 99:59:59,999
Yes, it's ready.

357
99:59:59,999 --> 99:59:59,999
So…

358
99:59:59,999 --> 99:59:59,999
It's 1.1GB.

359
99:59:59,999 --> 99:59:59,999
Is this really the… oh yeah, raw.

360
99:59:59,999 --> 99:59:59,999
No problem, let's download it, it should
be fast.

361
99:59:59,999 --> 99:59:59,999
This is the normal architecture if you use
FAI in a client/server set up.

362
99:59:59,999 --> 99:59:59,999
You should just look on the left side
where you see

363
99:59:59,999 --> 99:59:59,999
you need the config space, an nfsroot
and a mirror

364
99:59:59,999 --> 99:59:59,999
and these parts will put onto the CD.

365
99:59:59,999 --> 99:59:59,999
If you ??? network installation thing,

366
99:59:59,999 --> 99:59:59,999
this is of things get from the server
to the client.

367
99:59:59,999 --> 99:59:59,999
For the software installation, we have
another subdirectory called package_config

368
99:59:59,999 --> 99:59:59,999
and there you also see several files
where the file name is a FAI class.

369
99:59:59,999 --> 99:59:59,999
Since in the FAI.me service every client
belongs to the class DEBIAN,

370
99:59:59,999 --> 99:59:59,999
it will install the packages that are listed
on the ???

371
99:59:59,999 --> 99:59:59,999
and here we have an other class, NONFREE

372
99:59:59,999 --> 99:59:59,999
These packages are only installed if
you also said

373
99:59:59,999 --> 99:59:59,999
"Please install the nonfree packages"

374
99:59:59,999 --> 99:59:59,999
and this is mapped to a FAI class
called NONFREE.

375
99:59:59,999 --> 99:59:59,999
And there's an other class for AMD64
and so on.

376
99:59:59,999 --> 99:59:59,999
Some references.

377
99:59:59,999 --> 99:59:59,999
In the past, it looked more like this
when I said

378
99:59:59,999 --> 99:59:59,999
"Oh, who's using FAI?" and during
the last month I collected some logos

379
99:59:59,999 --> 99:59:59,999
just because it's much nicer.

380
99:59:59,999 --> 99:59:59,999
Let's see if the download was ready.

381
99:59:59,999 --> 99:59:59,999
We unzstd the FAI.me image,
faime-013Z image

382
99:59:59,999 --> 99:59:59,999
On the web site, I said I want to have
a 8GB partition,

383
99:59:59,999 --> 99:59:59,999
so now let's see how big it is.

384
99:59:59,999 --> 99:59:59,999
The file is 8, but since it's a sparse file
it's only 3.5GB

385
99:59:59,999 --> 99:59:59,999
and the compressed was 1.1GB.

386
99:59:59,999 --> 99:59:59,999
Now I use my wrapper

387
99:59:59,999 --> 99:59:59,999
and I say "Boot from disk" and this is
the FAI.me raw image, disk image

388
99:59:59,999 --> 99:59:59,999
that should be booted up.

389
99:59:59,999 --> 99:59:59,999
That's it.

390
99:59:59,999 --> 99:59:59,999
debian/fai

391
99:59:59,999 --> 99:59:59,999
Let's see if emacs is installed, yes.

392
99:59:59,999 --> 99:59:59,999
Gimp is already there, hopefully, and
the blue midnight commander.

393
99:59:59,999 --> 99:59:59,999
Let's see.

394
99:59:59,999 --> 99:59:59,999
Questions.

395
99:59:59,999 --> 99:59:59,999
[Q] I'm using the preseed file for
the debian-installer,

396
99:59:59,999 --> 99:59:59,999
do you have a conversion between
your syntax and your configuration files

397
99:59:59,999 --> 99:59:59,999
and the preseed file or maybe can you add
a download button for the preseed file

398
99:59:59,999 --> 99:59:59,999
to your web site because I think it's
rather nice to have it displayed

399
99:59:59,999 --> 99:59:59,999
in web site first.

400
99:59:59,999 --> 99:59:59,999
[A] I'm not using the debian-installer.

401
99:59:59,999 --> 99:59:59,999
I use preseeding, yes, the debconf
preseeding for the normal packages

402
99:59:59,999 --> 99:59:59,999
you can do this also in FAI and it's
the same format

403
99:59:59,999 --> 99:59:59,999
you get with debconf-get-selections.

404
99:59:59,999 --> 99:59:59,999
And what you get is you can download
your own FAI config space

405
99:59:59,999 --> 99:59:59,999
and this includes all information you need
to set up,

406
99:59:59,999 --> 99:59:59,999
to do this mirror FAI CD or the FAI disk
image command.

407
99:59:59,999 --> 99:59:59,999
But you cannot convert this config into
a d-i preseeding or vice versa,

408
99:59:59,999 --> 99:59:59,999
that's not possible.

409
99:59:59,999 --> 99:59:59,999
Because for example, for the partitioning
part I do not like to create

410
99:59:59,999 --> 99:59:59,999
from my disk config partman preseeding
file.

411
99:59:59,999 --> 99:59:59,999
You can pay me a lot of money, I will
never do this.

412
99:59:59,999 --> 99:59:59,999
You know that the partman preseeding
is very ugly and very heavy.

413
99:59:59,999 --> 99:59:59,999
For other things, yes, selection of,
for example, the selection of the language

414
99:59:59,999 --> 99:59:59,999
These are the normal preseeding we use.

415
99:59:59,999 --> 99:59:59,999
And the list of packages, task selec…

416
99:59:59,999 --> 99:59:59,999
I think it's much easier to do this in
the FAI configuration than to create

417
99:59:59,999 --> 99:59:59,999
a debian-installer preseeding.

418
99:59:59,999 --> 99:59:59,999
And why use d-i if this works for you?

419
99:59:59,999 --> 99:59:59,999
[Q] d-i works as well for me.

420
99:59:59,999 --> 99:59:59,999
[A] Yes, then fine, use it.

421
99:59:59,999 --> 99:59:59,999
[Q] Hi Thomas. Thank you very much for
this new feature in the FAI project,

422
99:59:59,999 --> 99:59:59,999
it's very nice and I found very great that
you have the output of the commands

423
99:59:59,999 --> 99:59:59,999
that you used to create the ISO image or
the cloud file.

424
99:59:59,999 --> 99:59:59,999
A question that I have is, in which servers
are located the files that we create,

425
99:59:59,999 --> 99:59:59,999
the ISO or the cloud.

426
99:59:59,999 --> 99:59:59,999
Is it a server that you own host or…

427
99:59:59,999 --> 99:59:59,999
[A] Trust me.

428
99:59:59,999 --> 99:59:59,999
Currently,

429
99:59:59,999 --> 99:59:59,999
both the web server and the FAI.me
processing build server are run

430
99:59:59,999 --> 99:59:59,999
on two machines at the university where
I work as a system administrator

431
99:59:59,999 --> 99:59:59,999
so that's also where we have a very fast
connection.

432
99:59:59,999 --> 99:59:59,999
The CGI script and shell script that is
processing these jobs is currently

433
99:59:59,999 --> 99:59:59,999
not open source.

434
99:59:59,999 --> 99:59:59,999
There are plans to do this, I'm not sure
when.

435
99:59:59,999 --> 99:59:59,999
If you want to reproduce the things, you
have the config file and you can download

436
99:59:59,999 --> 99:59:59,999
the FAI software and use these one or two
commands to reproduce it.

437
99:59:59,999 --> 99:59:59,999
Some people said "Oh, very nice service,
I would like to set up in my company".

438
99:59:59,999 --> 99:59:59,999
Then please yes, contact me and…

439
99:59:59,999 --> 99:59:59,999
Currently there are no concrete plans
to make these background scripts open source

440
99:59:59,999 --> 99:59:59,999
but it will be in some future.

441
99:59:59,999 --> 99:59:59,999
But currently, you have to trust me as
you also have to trust the package maintainers

442
99:59:59,999 --> 99:59:59,999
that will be installed there.

443
99:59:59,999 --> 99:59:59,999
But you can verify it or say "I do not
trust Thomas but I will just grab

444
99:59:59,999 --> 99:59:59,999
the FAI config space and this on my own".

445
99:59:59,999 --> 99:59:59,999
[Q] Thank you.