Return to Video

Interview with Neil - Web Development

  • 0:00 - 0:02
    Hey everybody.
  • 0:02 - 0:05
    We are joined right now by my friend Neil Williams,
  • 0:05 - 0:08
    who is currently the lead engineer at Reddit.
  • 0:08 - 0:11
    Maybe you can tell them a little bit about what your job entails these days.
  • 0:11 - 0:17
    >> Well, I basically focus first on fixing anything if it's broken, and
  • 0:17 - 0:22
    otherwise I try to figure out what's, what's the path for the site, like what's
  • 0:22 - 0:28
    becoming a bottleneck and then try and fix that and make the site fast again.
  • 0:28 - 0:31
    >> How much traffic does Reddit get these days?
  • 0:31 - 0:33
    >> Last month we got 2.7 billion page views.
  • 0:33 - 0:36
    >> That's billion with a b.
  • 0:36 - 0:38
    And I think when I left Reddit,
  • 0:38 - 0:42
    which was in 2009, we were nowhere close to that amount of traffic.
  • 0:42 - 0:45
    I don't remember specifically but I think it's like 10x difference.
  • 0:45 - 0:50
    I thought Reddit was pretty big when I left, and it was, but
  • 0:50 - 0:56
    it's a lot bigger now and, and Neil and his team are basically the guys
  • 0:56 - 1:00
    responsible for keeping the site fast, online and functional.
  • 1:00 - 1:01
    Which, you know,
  • 1:01 - 1:04
    over the course of Reddit's history, has that always been the case?
  • 1:05 - 1:07
    >> We try. >> Yeah, you know, you guys do a very good job.
  • 1:07 - 1:10
    It's a very impressive job.
  • 1:10 - 1:11
    So what we're going to do in this,
  • 1:11 - 1:14
    in this interview here, is I'm going to kind of, I'll,
  • 1:14 - 1:18
    I'll start off by describing how things worked with Reddit before I left.
  • 1:18 - 1:22
    And then as we said, traffic increased dramatically.
  • 1:22 - 1:25
    And Neil will show which parts of the system are gone and what they're doing
  • 1:25 - 1:29
    now towards the future because a lot of things have, have really changed.
  • 1:29 - 1:33
    You know when a site grows, grows by huge, huge amounts you,
  • 1:33 - 1:34
    you have to keep adjusting.
  • 1:34 - 1:38
    So so the way things were when I left if I recall,
  • 1:38 - 1:40
    Neil will jump in it's been a few years for me.
  • 1:40 - 1:45
    The first piece of infrastructure we had was the load balancer, and
  • 1:45 - 1:48
    we talked about load balancers in unit six.
  • 1:48 - 1:52
    The one we used was called HA proxy, and
  • 1:52 - 1:56
    you guys still use HA proxy, is that right?
  • 1:56 - 2:01
    >> Yes we do. Yeah, it's fast, it never breaks and works for us all the time.
  • 2:01 - 2:02
    I remember the day I found HA proxy.
  • 2:02 - 2:06
    It was probably in 2007 and for, god, I mean even after I left for a while I,
  • 2:06 - 2:10
    is this still the case, do you have, you have multiple HA proxys now, right?
  • 2:10 - 2:12
    >> Yes. >> Like we were for
  • 2:12 - 2:17
    a long time, like we had this super scalable architecture and one HA proxy.
  • 2:17 - 2:19
    We had one machine running one HA proxy and
  • 2:19 - 2:21
    that handled millions of requests a day.
  • 2:21 - 2:23
    It was pretty incredible.
  • 2:24 - 2:29
    So of course, outside of HA proxy is the internet and
  • 2:29 - 2:34
    all of the Redditors, the unwashed masses of the world, users of the site.
  • 2:34 - 2:36
    We also used Akamai.
  • 2:36 - 2:38
    >> Yes.
  • 2:38 - 2:38
    >> Do you guys still use Akamai?
  • 2:38 - 2:39
    >> Yes we do.
  • 2:39 - 2:44
    >> Remember we talked about CDN's, Content Delivery Networks in the,
  • 2:44 - 2:45
    in the last unit.
  • 2:45 - 2:48
    Basically these are third-party caches.
  • 2:48 - 2:53
    So Reddit pays Akamai to ping the site periodically, cache the content and
  • 2:53 - 2:57
    deliver it to users who, can view cached content.
  • 2:57 - 3:01
    >> We use that for logged out users only.
  • 3:01 - 3:04
    Since everybody has their own personal page if they're logged in.
  • 3:04 - 3:06
    >> But logged out users all see.
  • 3:06 - 3:07
    >> The same content.
  • 3:07 - 3:08
    >> The same stuff.
  • 3:08 - 3:10
    >> So, so logged out users hit Akamai.
  • 3:12 - 3:15
    And logged in users who have custom content, you know their username,
  • 3:15 - 3:20
    their votes, all that stuff come in via the internet, and hit HA proxy directly.
Cím:
Interview with Neil - Web Development
Leírás:

more » « less
Video Language:
English
Team:
Udacity
Projekt:
CS253 - Web Development
Duration:
03:21

English subtitles

Felülvizsgálatok Compare revisions