Senior Machine Learning Engineer, Ads Response Prediction

As a Senior Machine Learning Engineer on the Ads Response Prediction team, you will own and execute the development of ML models that power Instacart's ads ecosystem. This is a research-leaning role focused on theoretical problem formulation, training methodology, and model quality rather than infrastructure or full-stack engineering. You will work on meaningful challenges in pCTR modeling such as mitigating selection bias, position bias, and optimizer's curse in training data, improving model calibration across surfaces and domains, and advancing our multi-task learning and sequence modeling capabilities. You will contribute to our foundation model approach for ads ranking and work on cutting-edge retrieval systems like TIGER (Transformer Index for Generative Recommenders), Semantic ID and domain language models.

The Ads Response Prediction team owns all systems, algorithms and ML models to ensure a relevant and engaging Ads experience to customers of all the platforms powered by Instacart. This includes search and exploration retrieval systems, sequential modeling and generative retrieval systems for next interaction recommendations, LLM integrations, relevance models, pCTR models, bidding models and incrementality models. The team optimizes for an efficient marketplace to ensure delightful customer shopping experience, desirable advertiser business outcome and Instacart Ads revenue.

The team has strong ML infrastructure and MLOps support, including Delta/DBT-Spark data pipelines, Ray-based distributed training, and automated model deployment. This means you can focus your energy on advancing modeling science rather than building infrastructure.

• Own and execute research and development of pCTR and conversion prediction models, with a focus on improving calibration, reducing training data biases (selection bias, position bias, optimizer's curse), and advancing model accuracy across Instacart's ads surfaces.
• Design and implement debiasing techniques such as Mixed Negative Sampling (MNS), Inverse Propensity Weighting (IPW), counterfactual risk minimization, and calibration methods (Platt scaling, isotonic regression) to address systematic prediction biases.
• Contribute to the next-generation Multi-Domain Multi-Task (MDMT) model architecture, incorporating innovations like Mixture-of-Experts (MoE), Transformer layers for sequential user behavior, and LoRA adapters for scalable domain fine-tuning.
• Contribute to sequence modeling initiatives including the TIGER generative retrieval system and Semantic ID representation learning, expanding their application across ads surfaces such as Product Details, Search and other placements.
• Collaborate with the broader ML community in the company on the path toward Foundation Models using autoregressive user behavior prediction.
• Formulate and scope ambiguous modeling problems within your project scope from first principles. Translate business observations (e.g., overcalibration patterns, cold-start underperformance) into well-defined ML research directions with clear evaluation criteria.
• Publish and present findings internally. Contribute to the team's culture of technical rigor through design reviews, paper sharing, and experiment retrospectives.