LEARNING FROM FIRST PRINCIPLES
I knew models well
Training & fine-tuning
Evaluation & benchmarking
Applied AI research
vLLM, Flash Attention
Training & fine-tuning
Evaluation & benchmarking
Applied AI research
vLLM, Flash Attention
I had overlooked infrastructure
How models run in production
GPU utilization & scheduling
Routing & autoscaling
Deployment & operations
How models run in production
GPU utilization & scheduling
Routing & autoscaling
Deployment & operations
years of experience
blind spot
Best way to learn?
Join the team building it.
Join the team building it.