AI Automation, Data Scientist, Data Engineer, Educator
This project involves the development of a real-time analytics dashboard designed to process and visualize voting data for an election simulation involving three political parties: Party A, Party B, and Party C. The system integrates multiple technologies to handle data streaming, processing, and visualization, demonstrating proficiency in modern data engineering tools. For a detailed overview, …
This project demonstrates the development of a real-time data pipeline for e-commerce sales analytics using Apache Kafka, Apache Flink, PostgreSQL, and Elasticsearch. The pipeline ingests high-throughput transaction data, processes it for real-time insights, and stores it for querying and visualization, addressing needs such as inventory optimization and fraud detection. For more details, refer to the …
In today’s data-driven world, real-time monitoring of database changes is critical for applications like fraud detection and live analytics dashboards. This project demonstrates a robust real-time data pipeline using PostgreSQL, Debezium, and Kafka, orchestrated with Docker, to capture and stream database changes efficiently. The project includes: Features Technology Used Learn More Link: Read the full …
This repo shows how to use AWS EMR and Apache Spark to process big data in the cloud. It includes scripts and notes from my Medium guide on setting up and running Spark jobs. Key Features Tech Stack Link: Read the full article on Medium Code: https://github.com/shj37/AWS-EMR-Scalable-Spark-Processing
This project is a real-time data pipeline that keeps tabs on YouTube video stats—like likes and views—using Kafka and ksqlDB. It pulls data from the YouTube Data API, processes it on the fly, and sends me a Telegram message when something noteworthy changes. How It Works Tech Stack Why It MattersIt’s a hands-on showcase of …
Summary Skills: Fine Tuning · Large Language Models (LLM) · Natural Language Processing (NLP) · TPU · GPU · Artificial Intelligence (AI) · LoRA · QLoRA · FinTech · financial risk compliance · Chatbot Development · Keras · PyTorch · Project Management · Gemma-2b · Gemma-7b · Data Cleaning · Synthetic Data Generation Highlights Project …
Role: Student AI Researcher at Skinopathy Skills: Artificial Intelligence (AI) · speech-to-text · Fine Tuning · QLoRA · Natural Language Processing (NLP) · Text-to-Speech Synthesis · Data Processing · Data Cleaning · OpenAI Whisper · Audio Recognition · Project Management
I conducted some preliminary tests to assess the efficacy of employing GPT-4 for analyzing reference documents and generating answers for tasks assigned in the first semester of my graduate certificate program. It’s worth noting that this project was carried out post-completion of those courses, and therefore, was not utilized for the assignments associated with those …
Recently, I discovered that even with the above comprehensive schedule encompassing all class choices, creating diverse timetables to meet various preferences can be time-consuming. For instance, some of my friends prefer not to have classes on Saturdays, others aim to condense classes into fewer days, and I personally want to avoid morning sessions. Additionally, there …
In the realm of online shopping and entertainment, we often encounter personalized recommendations like “You may also like this item” or “Recommended movies based on your preferences.” These suggestions stem from association rule mining algorithms, specifically market basket analysis. This method uncovers item relationships from historical data, shedding light on customer behavior and preferences. Recently, …