Data Scientist, Engineer, AI, Educator
In this recent project, detailed in the article Implementing CI/CD for Azure Data Engineering with Terraform, I explored the integration of Continuous Integration and Continuous Deployment (CI/CD) practices to streamline data engineering workflows on Microsoft Azure using Terraform. This project demonstrates my expertise in automating infrastructure deployment and managing complex data pipelines efficiently. Key Objectives …
This project was about building a straightforward, scalable data pipeline for healthcare data using modern tools and cloud tech. For a full breakdown of the process, challenges, and insights gained, check out my article on Medium: https://medium.com/@jushijun/building-an-end-to-end-data-pipeline-for-healthcare-data-with-bigquery-dbt-and-github-ci-cd-8e772b01e318 Github: https://github.com/shj37/dbt-redshift-aws-banking-data-warehouse GoalCreate a pipeline to ingest, transform, and deploy healthcare data for actionable insights. Tools Used How …
This project combines Retrieval-Augmented Generation (RAG) with AWS for scalability, GitHub CI/CD for automation, and Docker for deployment reliability. It’s a practical dive into AI and DevOps that’s transforming education. Check out the full story on Medium: Read the article from developers’ perspectives, Read the article from educators’ perspectives. Github: https://github.com/shj37/medical_aws_CICD