— Data Engineering
WoW AH Assistant
A data pipeline and dashboard for World of Warcraft auction-house prices, built during the InFiNetCode Clean Code Hackathon 2025.
DLT DBT DuckDB Dagster Python Streamlit Blizzard API
~ when Jun 2025 – Jul 2025
~ status Archived
~ team collaborative
~ kind Hackathon Project
A data pipeline and interactive dashboard for World of Warcraft's Auction House, built during the InFiNetCode Clean Code Hackathon 2025 with a team of four.
ELT Pipeline
- Ingestion via dlt - fetches auction, item, and realm data from Blizzard's API with multithreaded parallel calls (10 concurrent workers) across all EU connected realms
- Custom rate limiter - token-bucket with thread safety and automatic hourly cooldown to handle Blizzard's 36k req/hour limit
- Transformation via dbt - proper star schema with 5 dimension tables, 1 fact table, and 3 mart tables
- Storage in DuckDB as the embedded analytical database
- Orchestration via Dagster with dlt + dbt asset integration and cron-scheduled refreshes (every 2 hours)
Dashboard
- Streamlit with AG Grid tables featuring custom JS cell renderers
- WoW-accurate rarity colors, item icons, and gold/silver/copper price formatting
- Browse items and compare auction prices across realms
Team
About this chart
Each axis is a functional pillar; the orange area is where my focus went, and the purple how much of that work was AI-augmented. That AI layer is where tools sped up implementation - architecture, code review, and the quality bar stay mine. I treat AI as a precision tool with strict conventions, not auto-pilot.