Sep 3, 2020

[Beam] Timely (and Stateful) Processing

The main (or even the only) reason for using Java based Beam is for it's time + stateful batch records processing.

Beam provides to some extend Go API to call with, but unfortunately it's run-time is in JVM.

Look beyond the language part, the design and idea is based on Tyler Akidau's book as well as 2 articles noted here:
https://vsdmars.blogspot.com/2019/12/streaming-notes.html 

And in this article uses Beam to realize(or Beam is based on above idea) the design.

Timely (and Stateful) Processing with Apache Beam : https://beam.apache.org/blog/timely-processing/


No comments:

Post a Comment

Note: Only a member of this blog may post a comment.