Apache Beam: An advanced unified programming model
copied from cf-staging / apache-beamconda install conda-forge::apache-beam
conda install conda-forge/label/cf201901::apache-beam
conda install conda-forge/label/cf202003::apache-beam
Apache Beam is an open source, unified model for defining both batch and streaming data-parallel processing pipelines. Using one of the open source Beam SDKs, you build a program that defines the pipeline. The pipeline is then executed by one of Beam’s supported distributed processing back-ends, which include Apache Apex, Apache Flink, Apache Spark, and Google Cloud Dataflow.