Sophie Yin
← All work

ML platform

2022 · Shipped · Built at Alt · Snowflake, Airflow, AWS

Case study

Code is private
Problem

Every pricing model shared one aging pipeline: slow runs, a growing compute bill, and deploys that failed in serving and had to be crash-reverted in production.

What it does

A re-architected ML platform: a Snowflake-backed data layer feeding restructured Airflow DAGs, an optimized time-series cache for training and serving, and a pre-deployment testing framework that catches serving and environment failures before they reach production.

Architecture
  1. 01Snowflake data layer
  2. 02Restructured Airflow DAGs
  3. 03Optimized time-series cache
  4. 04Pre-deployment test gate
  5. 05Production serving
Stack
  • DataSnowflake
  • OrchestrationAirflow
  • CachingCustom time-series cache
  • TestingPre-deployment framework
  • MonitoringDatadog
Outcomes
  • Production pipeline runtime down 40%
  • Compute costs down 43% — about $95K/year
  • Pre-deployment gate ended the crash-and-revert cycle

Code is private — happy to walk through it.

Curious how this would look on your problem?

sophie.fc.yin@gmail.com
Seattle, WA · Sophie YinLinkedIn