Portfolios – Shijun's portfolio

Shijun's portfolio

Data Scientist, Engineer, AI, Educator

Real-Time Algorithmic Trading System with Apache Flink, Redpanda, and News Sentiment Analysis

Apache Flink Apache Kafka / Redpanda Data Engineering Docker Machine Learning Python SQL

Real-Time Anomaly Detection Pipeline for Stock Trading Data with Redpanda and Quix

Apache Kafka / Redpanda Data Engineering Docker FinTech Machine Learning Python

CI/CD for Azure Data Engineering with Terraform

Azure CI/CD Data Engineering Terraform

Real-Time Voting Analytics Dashboard with Kafka, Spark, PostgreSQL, and Streamlit

Apache Kafka / Redpanda Apache Spark Data Engineering Docker SQL

Real-Time E-Commerce Data Pipeline with Kafka, Flink, PostgreSQL, and Elasticsearch

Apache Flink Apache Kafka / Redpanda Data Engineering Docker Elasticsearch SQL

Real-Time Data Streaming: Monitoring Database Changes with Postgres, Debezium, and Kafka

Apache Kafka / Redpanda Data Engineering Docker Python SQL

AWS EMR for Scalable Spark Processing: A Comprehensive Guide

Apache Spark AWS Data Engineering Python

Employee Churn Prediction Pipeline with BigQuery, PyCaret, and Looker Studio

GCP Looker Studio Machine Learning Python

Real-Time YouTube Analytics Pipeline with Kafka and ksqlDB

Apache Kafka / Redpanda Data Engineering Docker GCP SQL

Building a Real-Time Data Pipeline with Apache Airflow, Kafka, Spark, and Cassandra

Airflow Apache Cassandra Apache Kafka / Redpanda Apache Spark Data Engineering Docker

Automating Healthcare Data Pipelines with Airflow, BigQuery, and dbt

Airflow Data Engineering DBT Docker GCP

Building an End-to-End Data Pipeline for Healthcare Data with BigQuery, dbt, and GitHub CI/CD

CI/CD Data Engineering DBT GCP

Building a Banking Customer Data Warehouse: An End-to-End Guide Using AWS and dbt

AWS Data Engineering DBT

Implementing a Medallion Architecture Data Pipeline on Azure with Data Factory, Databricks, and DBT

Azure Data Engineering Databricks DBT

Building a Course-Specific AI Study Assistant: Integrating RAG, AWS, GitHub CI/CD, and Docker

AI AWS CI/CD Data Engineering Data Science Docker Educational Technology LLM LLMOps RAG

Building a Weather Data Pipeline with Apache Airflow, AWS, and Amazon RDS

Airflow AWS Data Engineering

Building an Incremental Data Pipeline with dbt, Snowflake, and Amazon S3

AWS Data Engineering DBT Snowflake

Real-Time Weather Data Streaming and Analysis on Azure

Azure Data Engineering

KaggleX Fellowship: Fine-tune Gemma-2b, Gemma-7b; FinTech

AI Data Science LLM Machine Learning Programming Python

Fine-tune OpenAI Whisper Large-V3 Turbo

AI Data Science Machine Learning Programming Python

Data Engineering: Sentiment Analysis Pipeline using Microsoft Fabric

Azure Data Engineering

Migrating On-Premise SQL to Azure Using Medallion Architecture

Azure Data Engineering

Unlocking Knowledge: AI-Powered Conversations with Your Private Documents

AI Data Science LLM Python

Optimizing Your Class Schedule: A Customized and Automatic Generator

Programming Python

Unveiling Customer Behavior through Marketing Basket Analysis with Apriori Algorithm

AI Data Science Machine Learning Marketing Python

(R, LaTeX) Teaching Graphs for Enhanced Understanding

Economics Latex Programming R Teaching

Teaching Portfolio and History Summary

Teaching

(Unity, C#) Interactive Virtual Classroom for Enhanced Learning

Economics Educational Technology Programming Teaching VR(Unity)

(D3.js) Interactive Exam Question Visualization

Data Science Economics Educational Technology javascript Programming Teaching

(React.js) Enhanced Essay Writing Tool for Efficient Topic Management

Economics Educational Technology javascript Programming Teaching

(js) Interactive Mind Mapping Tool for Efficient Idea Organization

Economics Educational Technology javascript Programming Teaching

(Python) Enhanced oTree Study/Exam System – Otree/Python

Economics Educational Technology Programming Python Teaching

(WordPress) Educational Websites LiuXueWangXiao.com 3auk.com LiuXueZiKao.com

Educational Technology Programming Teaching Wordpress

(js) WeChat MiniApp Educational Platform: Enhancing Learning with Interactive Features

Educational Technology javascript Programming Teaching

(Python) Web Scraping and Data Collection: Transforming Educational Information with Python

Data Science Educational Technology Programming Python

(Python, js) Educational Animation Videos and Data Sharing on Social Media: Bridging Education and Technology

Educational Technology Programming Python Social Media