Adapter for dbt that executes dbt pipelines on Apache Flink

📡 Real-time data pipeline with Kafka, Flink, Iceberg, Trino, MinIO, and Superset. Ideal for learning data systems.

Different flavours of CUSUM for change point detection.

Real-time ETL pipeline for financial data (kafka, pyspark) .

Online, interpretable anomaly detection for industrial sensor streams — self-adapting operating limits, root-cause isolation, no labels or retraining.

This repo provides a template for developing Cumulocity Streaming Analytics assets such as Blocks and EPL Apps, with a dev container for opening in Visual Studio Code

Real-time geopolitical instability prediction system using Apache Kafka, Apache Spark, XGBoost, NLP, and GDELT data for streaming analytics and risk forecasting.

Real-time monitoring pipeline using Kafka, Flink, PostgreSQL, and Grafana to stream metrics, detect anomalies (EWMA + 3σ), and visualize results.

Real-time Coinbase market data streaming pipeline with visualizations. Much appreciation to DataTalks.Club Data Engineering Zoom Camp: https://github.com/DataTalksClub/data-engineering-zoomcamp

An end‑to‑end real-time analytics & anomaly detection with PySpark Structured Streaming on user activity logs from Kafka

A Databricks-native reference architecture for distribution-based anomaly detection. Uses additive statistical moments, streaming histograms, and Wasserstein distance to detect sensor drift without static thresholds.

A real-life end-to-end cloud sub-system scenario

Custom capstone project demonstrating a Kafka streaming pipeline for real-time data processing, storage, and analytics using Python.

A Python/Tkinter app with MongoDB backend for streaming movies, managing subscriptions, and viewing analytics. Features user/admin roles, movie search, ratings tracking, and subscription management.

This project implements a real-time patient vital monitoring pipeline using Google Cloud Platform, enabling ingestion, processing, and analysis of streaming health data. Built with a cloud-native, scalable architecture, it transforms raw vital signals into actionable insights for monitoring and analytics

An intelligent streaming analytics platform that uses AWS Bedrock to process real-time data streams with ML-powered insights and automated decision making

Sub-second OLAP serving over a live event stream: ClickHouse incremental materialised views keep rollups fresh at insert time — no batch job. FastAPI + chDB/server.

Sentiment Analysis of Long-term of Social Data during the COVID-19 Pandemic

A data pipeline that streams Reddit comments from the 'Politics' subreddit using Kafka and Apache Spark. Processed data is stored in MongoDB for real-time analysis and management.

Agentic on-call analyst for live-stream incidents: bounded planning-loop agent over a governed semantic layer, evidence-cited RCA memos, root-cause accuracy measured against injected ground truth