Rethinking of "pipelining architecture" needed

[freol35241]

The current library has focus on iterating through a finite set of data, a process that is assumed to be able to be repeated as many times as necessary. However, when using this in a real-time application, this approach does not make sense...

[freol35241]

Callbacks or going async?

[freol35241]

https://streamz.readthedocs.io/en/latest/ ?

[freol35241]

python-streamz/streamz#433

[freol35241]

Can be handled as outlined in https://github.com/MO-RISE/crowsnest-connector-cluon-lidar/blob/main/main.py#L55-L110

Closing.