HackerTube.dev

dotScale 2015 - John Graham-Cumming - I got 10 trillion problems, but logging ain't one

dotconferences · 6.8K views · 2015-06-25 · 25:18

Open on YouTube ↗

If playback is restricted in your region, try opening the original video. Use Mark watched to add it to your marked videos.

Overview

John Graham-Cumming of Cloudflare talks at dotScale 2015 about handling roughly 10 trillion log lines a month. The talk touches on Cloudflare's hardware, its logging stack and its use of Lua in Nginx.

On Hacker News

Mostly cited as a source for details of Cloudflare's architecture, such as LuaJIT-based request inspection and request volumes.

Recommended by 1 HN people across 1 months · HN mentions 2015–2018

Topics

Search by tags

What people said

i336_ · 2016-01 · Recommendation

I discovered a moderately old video from CloudFlare hiding in there, and had a rather big TIL moment. It's one thing to read "LuaJIT is one of the fastest dynamic languages" etc blah blah on [LINK] ... ...it's quite another to learn that EVERY SINGLE CLOUDFLARE REQUEST - all 4 million/sec of them - goes through a LuaJIT-based attack detection system. Oh. Video: [VIDEO] (from [LINK] ) Found in the linked thread here: [LINK]

Read the original HN comment ↗
exikyut · 2018-06 · Reference

> Even putting aside that the computer tech part of the business isn't their core competency, custom hardware is hard. Hmmm. Good point. (Maybe I scared OP away, heh.) > Is there an example of any large company, other than Google, who has mastered this? Well, I certainly don't know. I've heard Cloudflare gets their systems made, for some definition of "from scratch", by Quanta. Presumably there's a bit of a decision-making process in there, and presumably Quanta handles everything related to the "why is the devkit sample broken again #51383" side of things and ships a more or less finished product (maybe even with finished enclosures). My reference point for this knowledge is [VIDEO] (2015). Regarding SAS, maybe past a certain ordering quantity (or anything similar that would reveal a massive operation) the market would expect certain behavior like requesting value-adds, ordering with only one supplier, or other things that would generate lock-in. I of course have absolutely no idea [if this sort of thinking is reasonable]. Your points about commodity at scale sound quite reasonable. (You clearly have more experience than I do, which is kind of zero, heh.) As for suspicion about summaries and conclusions, well, (tangential example) the radial graph on [LINK] (the one from Forrester) doesn't show GitHub :D Yeah, building own hardware is sadly still within the realm of over-specialization at this point. I guess this is because 4+-layer PCB printing is still eye-watering so the

Read the original HN comment ↗
Artemis2 · 2017-03 · Reference

For reference, two years ago Cloudflare was serving more than three million requests per second[0]. I can only imagine this figure has gone up a lot. 0: [VIDEO]

Read the original HN comment ↗

Sources

Video by dotconferences, played through YouTube.

Data and selection notes

HN summaries and labels may contain AI errors. HN dates refer to discussions, not video publication.

HN Library: HackerTube export (2026-10-31) and open-index/hacker-news. Upstream summaries and classifications may contain AI errors.

Views, duration and playback status refresh separately from the published catalog. When an update fails, existing data remains visible.

Selection checks
  • SaaS & AI candidates: Topic keywords do not match
  • Editor-approved picks: Editorial review is required

Rule matches identify candidates. They do not guarantee video quality or financial results.

About the library and its sources