Skip to content
#

cloud-dataflow

Here are 26 public repositories matching this topic...

Building a next-generation hybrid data pipeline architecture that combines the power of Microsoft Fabric, Azure Cloud, and Power BI. This pipeline is engineered to tackle the challenges of real-time data ingestion, multi-layered processing, and analytics, delivering business-critical insights.

  • Updated Dec 29, 2024
  • Python

Efficient Python data pipeline leveraging Apache Beam and Google Cloud Dataflow to update a Bucket with data concerning daily prices of instruments extracted from BMF website, serving as input for other data pipelines. The code generates a dataflow template, which is then scheduled to run periodically using Cloud Scheduler + Cloud Functions.

  • Updated Feb 28, 2024

Improve this page

Add a description, image, and links to the cloud-dataflow topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the cloud-dataflow topic, visit your repo's landing page and select "manage topics."

Learn more