Differential Dataflow

[gregr]

https://www.microsoft.com/en-us/research/wp-content/uploads/2013/01/differentialdataflow.pdf

This is another incremental computation paper, this time for updatable dataflow/streaming computations. The author blogs about achieving impressive performance while processing enormous amounts of data on a laptop that you'd normally use a cluster to process.

The project:
https://github.com/frankmcsherry/differential-dataflow

It compiles to Timely Dataflow operators:
https://github.com/frankmcsherry/timely-dataflow

Not sure if this background reading on Timely Dataflow is important:
https://dl.acm.org/citation.cfm?id=2522738

The blog (on github itself):
https://github.com/frankmcsherry/blog