Machine Learning Engineer - Quality Intelligence
AfterQuery
OnSite
San Francisco
AI
Job Score
80 pts
On-site model (+70)
AI (+10)
About AfterQuery
AfterQuery is an applied research lab curating data solutions for foundation model development.
We serve every frontier AI lab with the mission of delivering the best data to power the best models. In doing so, we can make expertise that once took a lifetime to build available to anyone who needs it. Our customers are the ones building the foundation models themselves and our work sits directly in the loop of how those systems improve.
This is a rare opportunity to join a company at a defining moment in AI. Since raising our $30M Series A at a $300M valuation, AfterQuery has grown well over a $100M revenue run rate.
We're based in San Francisco and backed by leading investors including Altos Ventures, BoxGroup, and Y Combinator and angels from Google DeepMind, OpenAI, Anthropic, Meta Superintelligence Labs, and Microsoft AI.
Machine Learning Engineer, Quality Intelligence
Overview
AfterQuery builds the data and evaluation systems that power frontier AI models. Every leading AI lab uses our datasets and reinforcement learning environments to encode and scale real-world expertise.
We’re hiring a Founding Machine Learning Engineer, Quality Intelligence to build the ML systems behind how we measure, improve, and scale data quality. You’ll work on production systems at the intersection of machine learning, human expertise, and frontier model evaluation.
This role is for someone who wants to build practical ML systems that directly improve the quality, reliability, and scalability of expert human data.
Responsibilities
Build ML and data systems that help measure quality across complex human data workflows
Develop systems for expert matching, quality prediction, and anomaly detection
Build evaluation infrastructure for tasks, reviewers, projects, and data deliveries
Turn messy real-world signals into models, metrics, and product improvements
Partner with engineers, domain experts, and operators to improve how high-quality data is created and reviewed
Own high-impact systems from early design through production deployment
Required Qualifications
3-6 YOE with relevant experiences
Strong software engineering background with experience shipping production systems
Experience with applied ML, ranking, recommendations, search quality, marketplace systems, trust/safety, fraud, or data quality systems
Strong data intuition and ability to work with messy, ambiguous real-world signals
Comfort working across backend systems, data pipelines, ML models, and internal tools
Ability to move quickly in a high-ownership, fast-changing environment
Deep care for quality, precision, and customer impact
Not a Fit If
You want to do pure research without owning production systems
You only want to train models and not build product infrastructure
You need clean datasets and perfectly scoped problems
You do not want to work closely with users, operators, and domain experts
About Artificial Intelligence
Artificial Intelligence is currently the fastest-growing field in the technology market. The revolution in generative models (GPT, Claude, Gemini) has created massive demand for AI-specialized professionals.
Key areas of practice include Machine Learning Engineering, MLOps, Prompt Engineering, AI Research, and Applied AI. Python, TensorFlow, PyTorch, and LLM knowledge are essential skills.
AI salaries are the highest in the technology sector, with many remote work opportunities at international companies.
Discover Other Areas
Understand the scope of work, key skills, and tools used in different career areas.
About Information Security
The Information Security area is one of the most strategic and in-demand fields in the technology market. With the rise of cyberattacks, data breaches, and regulations like LGPD and GDPR, companies of all sizes invest heavily in professionals who can protect their digital assets.
Key specializations include Network Security, Cloud Security (AWS, Azure, GCP), Offensive Security (Penetration Testing, Red Team), Defensive Security (SOC, Blue Team), AppSec, and Security Governance. Tools like SIEM (Splunk, QRadar), firewalls, EDR, and Vulnerability Management platforms are essential.
Certifications like CISSP, CEH, OSCP, CompTIA Security+, and AWS Security Specialty are important differentiators. Information security professionals are among the highest-paid in the sector, with growing demand especially in fintechs, healthtechs, and large enterprises.
About Graphic Designer
The Graphic Designer is the professional responsible for creating visual pieces for print and digital communication, from visual identity and logos to marketing materials and packaging. They combine creativity with technique to convey messages visually and impactfully.
Key skills include Adobe Photoshop, Illustrator, and InDesign, CorelDRAW, visual identity design, typography, color theory, packaging design, and motion graphics. Knowledge of vector illustration, offset/digital printing, and print production is a differentiator.
Graphic Designers in technology companies are highly valued, especially those who master social media design, infographics, and can create materials that strengthen brand visual identity. The field offers opportunities from junior graphic designer to art director and design director.
About Advertising
The Advertising area is aimed at the planning, creation, and delivery of communication campaigns to promote brands, products, ideas, or services. Professionals in the sector work in advertising agencies or in-house marketing departments in creative fields (art direction, copywriting), strategic planning, account management, and media buying.
About UX Design
The User Experience (UX) Design area focuses on optimizing the overall user experience when interacting with a product or service. UX professionals conduct user research (UX Research), map journeys, create wireframes, perform usability tests, and define navigation flows to ensure the product is intuitive, useful, and meets users' real needs.
About Digital Marketing
Digital Marketing is a constantly expanding field, driven by e-commerce growth and the need for a strong digital presence. Marketing professionals master tools like Google Ads, Meta Ads, HubSpot, Google Analytics, and automation platforms.
Most sought-after specializations include Growth Marketing, Performance, SEO, Content Marketing, and Growth Hacking. The combination of creativity with data analysis is the most valued differentiator in the market.
The market offers opportunities in both agencies and technology companies, with competitive salaries and remote work possibilities.