Machine Learning Engineer - Quality Intelligence
AfterQuery
OnSite
San Francisco
AI
Job Score
80 pts
On-site model (+70)
AI (+10)
About AfterQuery
AfterQuery is an applied research lab curating data solutions for foundation model development.
We serve every frontier AI lab with the mission of delivering the best data to power the best models. In doing so, we can make expertise that once took a lifetime to build available to anyone who needs it. Our customers are the ones building the foundation models themselves and our work sits directly in the loop of how those systems improve.
This is a rare opportunity to join a company at a defining moment in AI. Since raising our $30M Series A at a $300M valuation, AfterQuery has grown well over a $100M revenue run rate.
We're based in San Francisco and backed by leading investors including Altos Ventures, BoxGroup, and Y Combinator and angels from Google DeepMind, OpenAI, Anthropic, Meta Superintelligence Labs, and Microsoft AI.
Machine Learning Engineer, Quality Intelligence
Overview
AfterQuery builds the data and evaluation systems that power frontier AI models. Every leading AI lab uses our datasets and reinforcement learning environments to encode and scale real-world expertise.
We’re hiring a Founding Machine Learning Engineer, Quality Intelligence to build the ML systems behind how we measure, improve, and scale data quality. You’ll work on production systems at the intersection of machine learning, human expertise, and frontier model evaluation.
This role is for someone who wants to build practical ML systems that directly improve the quality, reliability, and scalability of expert human data.
Responsibilities
Build ML and data systems that help measure quality across complex human data workflows
Develop systems for expert matching, quality prediction, and anomaly detection
Build evaluation infrastructure for tasks, reviewers, projects, and data deliveries
Turn messy real-world signals into models, metrics, and product improvements
Partner with engineers, domain experts, and operators to improve how high-quality data is created and reviewed
Own high-impact systems from early design through production deployment
Required Qualifications
3-6 YOE with relevant experiences
Strong software engineering background with experience shipping production systems
Experience with applied ML, ranking, recommendations, search quality, marketplace systems, trust/safety, fraud, or data quality systems
Strong data intuition and ability to work with messy, ambiguous real-world signals
Comfort working across backend systems, data pipelines, ML models, and internal tools
Ability to move quickly in a high-ownership, fast-changing environment
Deep care for quality, precision, and customer impact
Not a Fit If
You want to do pure research without owning production systems
You only want to train models and not build product infrastructure
You need clean datasets and perfectly scoped problems
You do not want to work closely with users, operators, and domain experts
About Artificial Intelligence
Artificial Intelligence is currently the fastest-growing field in the technology market. The revolution in generative models (GPT, Claude, Gemini) has created massive demand for AI-specialized professionals.
Key areas of practice include Machine Learning Engineering, MLOps, Prompt Engineering, AI Research, and Applied AI. Python, TensorFlow, PyTorch, and LLM knowledge are essential skills.
AI salaries are the highest in the technology sector, with many remote work opportunities at international companies.
Discover Other Areas
Understand the scope of work, key skills, and tools used in different career areas.
About Project Management
Project Management is essential to ensure strategic initiatives are delivered on time, within scope, and with quality. PM professionals coordinate teams, manage risks, and communicate with stakeholders.
Key methodologies include PMBOK, PRINCE2, Scrum, and Kanban. Tools like Jira, Asana, Monday, and MS Project are widely used in daily work.
Certifications like PMP and PgMP are important differentiators in the market, with growing demand in technology and consulting companies.
About Automation Analyst
The Automation Analyst is the professional responsible for identifying process optimization opportunities and developing automated workflows (RPA, scripts, or integrations). They map manual and repetitive tasks across various company areas and build automation solutions using low-code/no-code platforms (such as Zapier, Make, Power Automate, n8n) or RPA tools (such as UiPath), driving operational efficiency and error reduction.
About Traffic Manager
The Traffic Manager is the professional responsible for planning, executing, and optimizing paid media campaigns across various digital platforms. With the competitiveness of the digital market, paid traffic professionals are essential for generating qualified leads and maximizing return on advertising investment.
Key skills include campaign management on Google Ads, Meta Ads, LinkedIn Ads, and TikTok Ads, media planning, metrics analysis (ROAS, CPA, CPC, CTR), A/B testing, remarketing, and landing page creation. Tools like Google Analytics, Google Tag Manager, Hotjar, and automation platforms are essential.
Traffic managers in technology companies are highly valued, especially those who master performance marketing, conversion funnel optimization, and scaling strategies. The field offers opportunities from media analyst to head of performance, with a focus on growth, budget efficiency, and return on investment.
About Systems Analyst
The Systems Analyst is the professional responsible for analyzing, designing, and implementing technology solutions that meet business needs. They act as a bridge between business areas and the development team, ensuring that systems deliver real value to the organization.
Key skills include requirements gathering and analysis, process modeling (BPMN), data modeling, technical and functional documentation, system integration (APIs, microservices), and knowledge of ERPs and CRMs. Tools like Jira, Confluence, Visio, and project management platforms are essential.
Systems Analysts in technology companies are highly valued, especially those who master agile requirements analysis (user stories, backlog), system integration, and solution architecture. The field offers opportunities from junior analyst to solution architect, with a focus on efficiency, quality, and technological innovation.
About Business Intelligence
Business Intelligence (BI) is the area responsible for transforming raw data into strategic information for decision-making. BI professionals build dashboards, reports, and analyses that help companies understand their performance and identify growth opportunities.
Key skills include data modeling (star schema, snowflake), ETL (extraction, transformation, loading), advanced SQL, BI tools (Power BI, Tableau, Looker), data warehousing, KPIs, and business metrics analysis (MRR, churn, cohort). Knowledge of dbt, Airflow, and data pipelines is a differentiator.
BI professionals in technology companies are highly valued, especially those who master data visualization, analytics engineering, and can translate complex data into actionable insights for the business. The field offers opportunities from BI analyst to head of data, with a focus on data-driven decision making.