Machine Learning Engineer, Core Experimentation
openai
Job Score
100 ptsAbout the Team
The Statsig team within OpenAI builds the experimentation, feature rollout, dynamic configuration, and analytics systems that help OpenAI ship products with speed, safety, and evidence. Our work sits on the critical path for how product, engineering, research, and go-to-market teams learn from real-world usage and make high-confidence decisions.
Statsig began as an independent company focused on helping builders move faster through trustworthy experimentation and feature management. After Statsig joined OpenAI, the team began the next chapter: bringing that deep product expertise, customer intuition, and mature platform infrastructure into OpenAI as the experimentation and rollout platform for every product we ship.
Today, we support teams across ChatGPT, Codex, model measurement, consumer experiences, business subscriptions, developer products, and the shared infrastructure that connects them. These teams rely on Statsig to safely introduce new capabilities, compare product and model behavior, measure impact, and roll changes forward or back with confidence.
We are at a defining moment in the platform journey. OpenAI has the data, product surface area, and pace of innovation to learn faster than almost any organization in the world, but that potential only becomes real if teams can experiment responsibly, measure clearly, and roll out changes safely.
We are evolving experimentation systems to help teams learn from product behavior and make better evidence-based decisions.
Based out of OpenAI’s Bellevue office, we are a close-knit team that values in-person collaboration, urgency, craft, and impact. We build for other builders, and the best version of this team is one where every OpenAI product team can move faster because the experimentation and rollout layer is dependable, fast, and easy to use.
About the Role
We are looking for a Machine Learning Engineer to lead the technical direction for ML-powered experimentation and insights capabilities. You will build production systems that learn from privacy-protected product and experimentation data to generate evidence-backed insights and support decision-making, and help teams decide which ideas are worth testing live.
This is an end-to-end, 0-to-1 role. You will work across ML modeling, retrieval and LLM systems, statistical methods, simulation, data and training pipelines, backend services, and user- and agent-facing product experiences. The hard part is not merely producing a plausible answer. It is making each insight and prediction traceable, calibrated, useful, and safe enough to influence real product decisions.
Live experiments remain the source of causal validation. You will design systems that make uncertainty explicit, backtest against historical outcomes, compare predictions with online results, learn from misses, and abstain when the evidence is weak. You will preserve clear review, permission, and approval boundaries as automation becomes more powerful.
You will collaborate closely with teams building ChatGPT, Codex, model measurement workflows, consumer products, Growth, business subscription experiences, developer products, and shared infrastructure. You will turn their most important learning and decision problems into general platform capabilities that can support the full company.
In This Role, You Will
Set and execute the technical roadmap for Generative Insights and Predictive Experimentation, from early prototypes through production adoption.
Build cross-experiment learning systems that retrieve and synthesize historical experiments, detect recurring effects and segment behavior, reanalyze prior results when data or methods improve, and generate hypotheses with clear evidence and provenance.
Develop predictive models and simulation workflows, including simulation-based evaluation approaches, to estimate likely impact, affected segments, regression risk, and uncertainty before a full live experiment.
Create high-quality datasets and feature or retrieval pipelines from exposures, events, metrics, experiment metadata, and replay data, with strong lineage, freshness, privacy, and data-quality controls.
Establish rigorous evaluation through offline benchmarks, backtests, calibration, drift monitoring, prediction-to-outcome comparisons, and explicit failure or abstention behavior.
Turn models into durable product, API, and agent workflows that move from an insight to experiment design, approval-gated action, and measured learning.
Partner deeply with data science and product teams on experiment design, causal inference, sequential decision-making, variance reduction, and the boundary between prediction and causal evidence.
Build reliable services and intuitive workflows so sophisticated ML capabilities are understandable and useful to teams making high-stakes product decisions.
Provide technical leadership across engineering, product, data science, and research partners, and raise the bar for production ML quality across the platform.
You Might Thrive In This Role If You
Have led ambiguous 0-to-1 production ML products where success was measured by better real-world decisions, not only offline model metrics.
Have strong hands-on experience across the ML lifecycle: dataset design, training or adaptation, evaluation, deployment, monitoring, and iteration.
Bring depth in one or more of LLM and retrieval systems, ranking or recommendation, forecasting or anomaly detection, causal ML or experiment analysis, or simulation. You do not need to have done all of them.
Have strong software engineering fundamentals and can build high-quality production systems in Python while working comfortably across data, backend, and platform boundaries.
Have a strong grounding in machine learning, statistics, computer science, or a related field through formal study or equivalent practical experience.
Understand experimentation and statistical reasoning, especially why predictive accuracy is not the same as causal validity.
Treat calibration, uncertainty, provenance, privacy, and human review as product requirements, not cleanup work.
Can translate ambiguous partner questions into a product and technical roadmap, and work well with product, data science, research, and infrastructure partners.
Enjoy building for internal power users and agents, and can make sophisticated ML capabilities feel clear and actionable.
Value in-person collaboration and want to help shape a growing Bellevue-based team.
Location and Workplace
This role is based in Bellevue, Washington. The team works in person and uses that time to move quickly, solve ambiguous problems together, and stay close to the product teams we support.
About OpenAI
OpenAI is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity. We push the boundaries of the capabilities of AI systems and seek to safely deploy them to the world through our products. AI is an extremely powerful tool that must be created with safety and human needs at its core, and to achieve our mission, we must encompass and value the many different perspectives, voices, and experiences that form the full spectrum of humanity.
We are an equal opportunity employer, and we do not discriminate on the basis of race, religion, color, national origin, sex, sexual orientation, age, veteran status, disability, genetic information, or other applicable legally protected characteristic.
For additional information, please see OpenAI’s Affirmative Action and Equal Employment Opportunity Policy Statement.
Background checks for applicants will be administered in accordance with applicable law, and qualified applicants with arrest or conviction records will be considered for employment consistent with those laws, including the San Francisco Fair Chance Ordinance, the Los Angeles County Fair Chance Ordinance for Employers, and the California Fair Chance Act, for US-based candidates. For unincorporated Los Angeles County workers: we reasonably believe that criminal history may have a direct, adverse and negative relationship with the following job duties, potentially resulting in the withdrawal of a conditional offer of employment: protect computer hardware entrusted to you from theft, loss or damage; return all computer hardware in your possession (including the data contained therein) upon termination of employment or end of assignment; and maintain the confidentiality of proprietary, confidential, and non-public information. In addition, job duties require access to secure and protected information technology systems and related data security obligations.
To notify OpenAI that you believe this job posting is non-compliant, please submit a report through this form. No response will be provided to inquiries unrelated to job posting compliance.
We are committed to providing reasonable accommodations to applicants with disabilities, and requests can be made via this link.
OpenAI Global Applicant Privacy Policy
At OpenAI, we believe artificial intelligence has the potential to help people solve immense global challenges, and we want the upside of AI to be widely shared. Join us in shaping the future of technology.
About Artificial Intelligence
Artificial Intelligence is currently the fastest-growing field in the technology market. The revolution in generative models (GPT, Claude, Gemini) has created massive demand for AI-specialized professionals.
Key areas of practice include Machine Learning Engineering, MLOps, Prompt Engineering, AI Research, and Applied AI. Python, TensorFlow, PyTorch, and LLM knowledge are essential skills.
AI salaries are the highest in the technology sector, with many remote work opportunities at international companies.
About Scrum Master
The Scrum Master is the professional responsible for facilitating the adoption of Scrum and agile practices within development teams. They act as servant leaders, removing impediments, promoting continuous improvement, and ensuring Scrum events and ceremonies happen in the best possible way.
Key skills include event facilitation (sprint planning, daily, review, retrospective), backlog management, team coaching, conflict resolution, and agile metrics (velocity, burndown, cycle time). Knowledge of Jira, Trello, Azure DevOps, and frameworks like Kanban, XP, and SAFe is a differentiator.
Scrum Masters in technology companies are highly valued, especially those who can promote team autonomy, create psychologically safe environments, and lead agile transformations at scale. The field offers opportunities from junior scrum master to agile coach, head of agile, and director of agile transformation.
Discover Other Areas
Understand the scope of work, key skills, and tools used in different career areas.
About Content
The Content and Social Media area is essential for building digital presence and audience engagement. Professionals create content strategies, manage social networks, and develop impactful brand narratives.
Key skills include copywriting, storytelling, community management, metrics analysis, audiovisual production, and knowledge of each platform algorithms.
With the growth of influencer marketing and social commerce, this area continues to generate new career opportunities.
About Human Resources
The Human Resources area is responsible for all people management in organizations, from attracting and selecting talent to developing, retaining, and ensuring employee well-being. HR professionals are fundamental to building strong organizational cultures and engagement.
Key skills include recruitment and selection, compensation and benefits management, learning and development (L&D), organizational climate, employee engagement, labor law, labor relations, and HR tools (Workday, SAP SuccessFactors, Bamboo HR). Knowledge of people analytics and data-driven HR is a differentiator.
HR professionals in technology companies are highly valued, especially those who master employer branding, people analytics, and talent retention strategies. The field offers opportunities from HR analyst to Chief People Officer, with a focus on culture, engagement, and people growth.
About Traffic Analyst
The Traffic Analyst (paid media/performance specialist) is the professional responsible for creating, managing, and optimizing sponsored ad campaigns on digital platforms such as Google Ads, Meta Ads, LinkedIn Ads, and TikTok Ads. They monitor conversion metrics, analyze return on investment (ROAS), perform A/B testing on ads and landing pages, and manage the marketing budget to maximize lead generation and qualified sales.
About Infrastructure and DevOps
Infrastructure and DevOps are responsible for creating, maintaining, and optimizing IT environments that support applications at scale. This area is fundamental for system reliability and performance.
Key technologies include AWS, GCP, Azure, Docker, Kubernetes, Terraform, Ansible, CI/CD (GitHub Actions, GitLab CI, Jenkins), and monitoring (Datadog, Grafana, Prometheus).
DevOps engineers and SREs are highly sought-after professionals, with salaries among the highest in the technology sector.
About Ecommerce Manager
The Ecommerce Manager is the professional responsible for the entire strategic and operational management of online stores and marketplaces. They lead teams, define pricing, promotion, and catalog strategies, and monitor online sales performance across multiple platforms.
Key skills include catalog management, dynamic pricing, seasonal campaigns (Black Friday, Cyber Monday), marketplace management (Amazon, Mercado Livre, Shopee, Magalu), paid traffic, CRO, and team management. Knowledge of Shopify, VTEX, WooCommerce, Google Ads, Meta Ads, and performance metrics is a differentiator.
Ecommerce Managers in technology companies are highly valued, especially those who master multi-marketplace management, checkout optimization, and mobile commerce strategies. The field offers opportunities from ecommerce manager to head of ecommerce, with a focus on revenue, customer experience, and growth.
Comments 0