Irrational Exuberance!

From lambda to kappa and dataflow paradigms.

November 22, 2017 A look at the evolution of data infrastructure over the past four or five years, from the lambda architecture to the kappa architecture and beam paradigm.

Providing pierceable abstractions.

May 7, 2017 We often try to force all usecases onto a single internal platform, and I think doing this causes our platforms to age poorly and with an excess of accidental complexity. This post suggests some alternatives

Options for orchestrating periodic tasks.

April 30, 2017 Wherein I spend some time exploring the current landscape for orchestrating periodic tasks and wrote up some loose notes.

Infrastructure between cost center and ego trip

March 5, 2017 Planning the work for infrastructure engineering organization can be a challenge, in part due to a lack of clarity around what such an organization contributes value to the company it operates within. I have thoughts, and a simple thinking aid, for that.

Braindump on Load Generation

December 18, 2016 As I'm starting to spend more time on load generation and load testing, I did some research for related papers and typed up notes afterwards.