Irrational Exuberance!

You can't reason about big balls of mud.

May 23, 2018 Big balls of mud appear to have properties, but they don't. Throw it all away? It's not so dire. You can extend large property-less systems. It's a matter of switching from abstract to empirical reasoning.

From lambda to kappa and dataflow paradigms.

November 22, 2017 A look at the evolution of data infrastructure over the past four or five years, from the lambda architecture to the kappa architecture and beam paradigm.

Providing pierceable abstractions.

May 7, 2017 We often try to force all usecases onto a single internal platform, and I think doing this causes our platforms to age poorly and with an excess of accidental complexity. This post suggests some alternatives

Options for orchestrating periodic tasks.

April 30, 2017 Wherein I spend some time exploring the current landscape for orchestrating periodic tasks and wrote up some loose notes.

Infrastructure between cost center and ego trip

March 5, 2017 Planning the work for infrastructure engineering organization can be a challenge, in part due to a lack of clarity around what such an organization contributes value to the company it operates within. I have thoughts, and a simple thinking aid, for that.