10 or more years of combined ML research and engineering experience, with significant LLM exposure.
Strong proficiency in Python and modern deep learning frameworks, especially PyTorch.
Hands-on experience fine-tuning transformer-based language models at non-trivial scale.
Familiarity with distributed training strategies including FSDP, ZeRO, and pipeline parallelism.
Experience with RLHF, DPO, or other preference optimization techniques.
Strong understanding of evaluation methodology, benchmarks, and human evaluation design.
Experience operating training jobs on GPU clusters and recovering from failures.
Strong written and verbal communication skills.
Track record of shipping or publishing impactful LLM work.
Publications at top-tier ML venues.
Experience with multimodal model fine-tuning.
Familiarity with synthetic data generation and dataset distillation.
Open-source contributions to LLM training libraries.
Exposure to responsible AI evaluation and red-teaming practices.

Foundation Model Engineer

Summary