Posts by Ben Birnbaum

Dobby: A simple hack for on-demand remote execution

Motivation: running long jobs on your laptop sucks At Flatiron, we run a lot of data pipelines. Early on, we were processing fairly small amounts of data, so investing a lot in tooling didn’t seem worth it. But around a year ago, we signed a contract that increased the number of patients we were processing by several orders of magnitude.