This project is a real-time data pipeline that keeps tabs on YouTube video stats—like likes and views—using Kafka and ksqlDB. It pulls data from the YouTube Data API, processes it on the fly, and sends me a Telegram message when something noteworthy changes.
How It Works
- Data Pull: Python scripts grab video data via the YouTube API and push it into Kafka.
- Real-Time Magic: ksqlDB analyzes the stream, spotting shifts in metrics.
- Alerts: A Telegram bot pings me with updates, tying it all together.
- Setup: Docker runs the show—Kafka, ZooKeeper, and more—for a smooth, portable system.
Tech Stack
- Python, Kafka, ksqlDB, Docker, YouTube Data API, Telegram Bot API
Why It Matters
It’s a hands-on showcase of streaming data skills, blending APIs, real-time processing, and notifications into something useful—and a little fun.
Link: Read the full article on Medium
Code: https://github.com/shj37/YouTube-Analytics-Kafka-ksqlDB-Telegram
