AI Engineering Advanced
AI Distillation Engineer
An AI Distillation Engineer specializes in compressing large-scale foundation models into smaller, faster, and cheaper student mod…
Demand 9.0/10
AI Risk 25%
Salary $120,000-$210,000/yr
Knowledge distillation theory and implementation (logit-based, feature-based, relation-based)PyTorch and Hugging Face Transformers for model training and evaluationQuantization techniques (GPTQ, AWQ, GGUF, INT8/INT4) and calibration data selectionModel architecture analysis - attention mechanisms, MoE routing, layer redundancy +8