← Back to jobs

Quality Control Lead

AfterQuery

OnSite San Francisco
Advertising

Job Score

80 pts
On-site model (+70) Advertising (+10)

About AfterQuery

AfterQuery is an applied research lab curating data solutions for foundation model development. We serve every frontier AI lab with the mission of delivering the best data to power the best models. In doing so, we can make expertise that once took a lifetime to build available to anyone who needs it.

Our customers are the ones building the foundation models themselves and our work sits directly in the loop of how those systems improve. This is a rare opportunity to join a company at a defining moment in AI. Since raising our $30M Series A at a $300M valuation, AfterQuery has grown well over a $100M revenue run rate. We're based in San Francisco and backed by leading investors including Altos Ventures, BoxGroup, and Y Combinator and angels from Google DeepMind, OpenAI, Anthropic, Meta Superintelligence Labs, and Microsoft AI.

Why Apply

Massive Opportunity: We are one of the fastest-growing YC companies in our batch, and we believe we can become one of the fastest-growing YC companies of all time.

Founding Impact: You will own and architect core infrastructure systems that power our platform from the ground up.

Equity & Growth: Competitive salary and meaningful equity. As we scale, you’ll have the opportunity to shape the engineering organization and lead major technical initiatives.

Strong Team: Our founding team has experience from Citadel Securities, Meta, Google, Silver Lake, and Morgan Stanley — work alongside world-class engineers and researchers.

We're looking for a Quality Control Lead to own the final checkpoint between raw data and delivered product. You'll be the person who decides what's good enough to ship, the coach who helps contributors get better, and the builder who automates away the errors that shouldn't happen twice.

Key Responsibilities

  • Final Quality Review: Own the last quality checkpoint before datasets are delivered or published, auditing outputs (including code, technical, and reasoning data) for correctness, clarity, structure, and adherence to spec.

  • QC Process & Tooling: Work with infrastructure engineers to continuously automate and improve QC workflows

  • Cross-Functional Feedback Loop: Partner with data delivery teams to identify systemic quality issues, feed corrections back into contributor training, and prevent recurrence.

  • Metrics & Reporting: Own quality metrics and KPIs, reporting on error rates, root causes, and improvement trends to company leadership.

  • Operational Support: Contribute to company-wide initiatives across building, analysis, coordination, and execution as AfterQuery scales.

Required Qualifications

  • 3+ years of experience in a technical role (software engineering, data science, ML engineering, or similar) with hands-on proficiency in at least one modern programming language

  • Proven ability to review, debug, and evaluate both code and technical data and knowledge work data for correctness, structure, and quality; demonstrated rigor in reviewing others' work

  • Experience building or leading a quality assurance/quality control function, ideally for a technical or data-centric product

  • Extremely high attention to detail and comfort making judgment calls on ambiguous or contested technical content

  • Strong leadership and communication skills; able to translate technical quality issues into clear, actionable feedback across a distributed team

  • High agency and strong work ethic; comfort operating with minimal direction in ambiguous, fast-moving environments

  • Genuine passion for AI and an entrepreneurial inclination

  • Demonstrated competitive success

Preferred Qualifications

  • Experience in AI training data, RLHF, or data-annotation quality assurance

  • Background reviewing datasets across multiple domains (code, reasoning, knowledge work)

  • Experience designing rubrics, grading criteria, or automated quality-check tooling/scripts

  • Familiarity with Claude Code or similar AI-assisted workflow tools

  • Computer science degree or equivalent hands-on engineering background

Company Benefits (For Eligible Employees):

  • Health Insurance: Medical, Vision, Dental

  • 401(k) with Employer Match

  • Daily Meals: Daily UberEats Stipend

  • Monthly Wellness Stipend

  • Commute Covered

We are an equal opportunity employer committed to providing a workplace free from discrimination and harassment. Employment decisions are made without regard to legally protected characteristics under applicable federal, state, or local law.

We comply with applicable pay transparency requirements and provide compensation ranges based on the position, qualifications, experience, and other relevant factors. Reasonable accommodations are available to qualified individuals with disabilities and for sincerely held religious beliefs, as required by law. This job description is intended to describe the general nature and level of work performed and is not an exhaustive list of all duties, responsibilities, qualifications, or working conditions associated with the position. We reserve the right to modify this job description as business needs change.

What did you think of this job?

Comments 0

Want to leave a comment?
Sign in or create your account in seconds to join the discussion.
Loading comments...

About Advertising

The Advertising area is aimed at the planning, creation, and delivery of communication campaigns to promote brands, products, ideas, or services. Professionals in the sector work in advertising agencies or in-house marketing departments in creative fields (art direction, copywriting), strategic planning, account management, and media buying.

Discover Other Areas

Understand the scope of work, key skills, and tools used in different career areas.

About Content Manager

The Content Manager is the professional responsible for leading the entire content strategy, production, and management of an organization. They define the editorial strategy, coordinate writing teams, and ensure content aligns with business goals and brand identity.

Key skills include content strategy, editorial planning, content audit, buyer persona, customer journey, content ops, content governance, performance metrics (ROI, engagement, organic traffic), and team management. Knowledge of WordPress, Contentful, Notion, and analytics tools is a differentiator.

Content Managers in technology companies are highly valued, especially those who can align content with conversion funnels, lead multidisciplinary teams, and use data to optimize editorial strategy. The field offers opportunities from content manager to head of content, with a focus on strategy, quality, and scale.

About Automation Analyst

The Automation Analyst is the professional responsible for identifying process optimization opportunities and developing automated workflows (RPA, scripts, or integrations). They map manual and repetitive tasks across various company areas and build automation solutions using low-code/no-code platforms (such as Zapier, Make, Power Automate, n8n) or RPA tools (such as UiPath), driving operational efficiency and error reduction.

About Customer Success

Customer Success is the area responsible for ensuring clients achieve their goals when using the product or service. It is a strategic function for retention, expansion, and customer satisfaction.

Key skills include account management, churn analysis, NPS, onboarding, upsell, and cross-sell. Knowledge of CS tools like Gainsight, Totango, and ChurnZero is a differentiator.

CS is becoming increasingly strategic in SaaS companies, with professionals directly contributing to recurring revenue growth (MRR/ARR).

About Agile

The Agile and Digital Transformation area is fundamental for organizations seeking efficiency and rapid adaptation. Agile professionals facilitate processes, eliminate bottlenecks, and promote a culture of continuous improvement.

Key certifications include CSM, PSM, SAFe, ICP, and Kanban. Knowledge of Scrum, Kanban, XP, and agile frameworks is essential, as are leadership and facilitation soft skills.

Senior Agile coaches and Scrum Masters are highly valued, especially in technology companies that adopt agile methodologies at scale.

About Ecommerce Manager

The Ecommerce Manager is the professional responsible for the entire strategic and operational management of online stores and marketplaces. They lead teams, define pricing, promotion, and catalog strategies, and monitor online sales performance across multiple platforms.

Key skills include catalog management, dynamic pricing, seasonal campaigns (Black Friday, Cyber Monday), marketplace management (Amazon, Mercado Livre, Shopee, Magalu), paid traffic, CRO, and team management. Knowledge of Shopify, VTEX, WooCommerce, Google Ads, Meta Ads, and performance metrics is a differentiator.

Ecommerce Managers in technology companies are highly valued, especially those who master multi-marketplace management, checkout optimization, and mobile commerce strategies. The field offers opportunities from ecommerce manager to head of ecommerce, with a focus on revenue, customer experience, and growth.

Career Guides

Technology Career Guide

Planning, skills, interviews, and professional growth in IT, Data Science, DevOps, and Product.

Read full guide →

Design Career Guide

UX/UI, Graphic Design, Product Design. Portfolio, tools, interviews, and growth in the Design field.

Read full guide →

Marketing Career Guide

SEO, Paid Media, Growth, Content Marketing. Certifications, tools, and strategies to grow in Digital Marketing.

Read full guide →

Finance Career Guide

Financial market, investments, corporate finance, certifications, and strategies to grow in the financial field.

Read full guide →

Communication Career Guide

Journalism, PR, Corporate Communication, Content Marketing, and Multimedia Production.

Read full guide →

Administration Career Guide

Business Management, HR, Logistics, Consulting, Project Management, and Entrepreneurship.

Read full guide →

Data Career Guide

Data Science, Data Engineering, BI, Machine Learning, and AI. From training to the job market.

Read full guide →

Product Career Guide

Product Management, Product Ownership, Agile, Scrum, and OKRs. From strategy to execution.

Read full guide →

Tech & Remote Glossary

Stop getting lost in interviews and job descriptions

The job market, especially within tech and global companies, has developed its own dialect. Not understanding these acronyms can make you lose valuable opportunities or poorly negotiate your contract. To end this problem, we created the Definitive Glossary for the Remote Professional.

🏢 Work Models & Routine

Async (Asynchronous Work)
A communication model where responses don't need to be immediate. Instead of back-to-back meetings, the team relies on well-structured documents, threads, and messages. It's the gold standard for global companies spanning multiple time zones.
Sync (Synchronous Work)
The opposite of Async. It requires the team to be online and available at the same time for meetings, live chats, and real-time collaboration.
Daily / Stand-up
A quick daily meeting (usually 15 minutes) common in Agile (Scrum) methodologies. The team answers three questions: What did I do yesterday? What will I do today? Are there any blockers?
All-Hands / Town Hall
A company-wide meeting involving all employees. Usually led by the founders (C-Levels) to present results, new goals, and answer team questions.
1:1 (One-on-One)
A recurring individual meeting between a professional and their direct manager. It is used for career alignment, feedback, and problem-solving, not just for project status updates.

💰 Contracts, Benefits & Compensation

PTO (Paid Time Off)
Instead of strict, categorized leave policies, modern US companies usually offer a flexible pool of days (e.g., 20 days of PTO, or even "Unlimited PTO") that you can use for vacations, sick days, or personal matters, while receiving your regular compensation.
Equity / Stock Options
Company ownership. The startup offers you the right to buy shares at a heavily discounted strike price in the future. If the company grows, goes public, or is acquired, these shares can be highly lucrative.
Vesting (Vesting Schedule)
The rule that controls your Equity. It usually lasts 4 years. You don't get all the shares on day one; you "earn" them gradually as you stay with the company. A "1-year Cliff" means you must stay for at least one year to receive your first batch of shares.
RSUs (Restricted Stock Units)
Unlike Stock Options (where you have the right to buy the stock), RSUs are actual shares the company grants you as a bonus or part of your compensation package, following a strict Vesting schedule.
Independent Contractor (1099 / B2B)
The most common international hiring model for global talent working for US companies. You act as a service provider (business-to-business), receiving the gross salary (often six-figure compensation) without standard local payroll tax deductions at the source.

🤖 Recruitment & Hiring Process

ATS (Applicant Tracking System)
The "robot" that reads your resume. Software like Greenhouse, Ashby, and Workday are used to filter candidates by keywords before a human even looks at the document. (Pro tip: this is why your resume must be clean, semantic, and have the right keywords).
JD (Job Description)
The document that lists the responsibilities, technical requirements, and benefits of the open position.
Cultural Fit
The interview stage that evaluates if your core values, communication style, and worldview align with the company's culture. This is the ultimate test of your Soft Skills.
Onboarding
The integration process. It's the period of your first few weeks at the company, where you get your access credentials, learn about the culture, study the internal documentation, and understand how the product works.

🚀 How to use this to your advantage?

The secret isn't just knowing what these acronyms mean, but using them actively. If during an interview for a premium tech role you ask, "How does your PTO policy and Vesting schedule work?", the recruiter will immediately perceive you as a high-level professional, familiar with the global market standards.

The remote job market requires preparation. And having the right vocabulary is the first big step to securing six-figure proposals and standing out among thousands of applicants.

Expert Tip

The Current State of the Cloud & DevOps Market

By Mondywork | The ultimate guide for tech professionals looking to level up their careers, land global remote roles, and master modern infrastructure.

The End of the "SysAdmin" and the Rise of Platform Engineering

If you've been tracking the most sought-after roles at startups and Fortune 500 companies, you've probably noticed a drastic shift. The Cloud Computing and DevOps market is no longer just about "keeping the app online." Today, companies demand extreme resilience, automation, and cost optimization (the famous FinOps).

DevOps culture has evolved. We are now in the era of Platform Engineering, where infrastructure teams build internal platforms to grant developers full autonomy (Self-Service). For those aiming for global remote roles with six-figure compensation, understanding this transition isn't just a plus—it's a strict requirement.

"Elite DevOps teams deploy code 973 times more frequently and boast a Mean Time To Recovery (MTTR) that is 6,570 times faster than low-performing teams."

— State of DevOps Report (DORA / Google Cloud)

What Do Recruiters and ATS Systems Really Look For?

Automated filters (ATS platforms like Greenhouse, Ashby, and Workday) are hardwired to scan for a very specific set of skills in Cloud/DevOps resumes. Simply listing 20 tools won't cut it anymore; you must demonstrate culture and real-world impact.

  • Infrastructure as Code (IaC): Forget clicking around the AWS console. Declarative tools like Terraform, Pulumi, and Ansible are the true industry standards.
  • Container Orchestration: Mastery of Docker and, above all, Kubernetes (K8s) is practically mandatory for premium roles.
  • CI/CD Culture: Building automated pipelines (GitHub Actions, GitLab CI, ArgoCD) that guarantee continuous and secure deployments.
  • Cloud Providers and Architecture: Proficiency in at least one major public cloud provider (AWS, Google Cloud, or Microsoft Azure), with a strong focus on Serverless, microservices, and system resilience.

How to Transition: The Roadmap to Success

Many Back-End developers, support analysts, and network professionals want to pivot to Cloud and DevOps. If that's your goal, follow this market-validated roadmap:

  1. Master the Basics (Linux and Networking): Modern DevOps runs on Linux. Understanding permissions, processes, bash scripting, and the fundamentals of TCP/IP, DNS, and Load Balancers is your foundation.
  2. Learn to Code: A DevOps engineer doesn't need to be a Senior Developer, but you must know how to automate tasks. Python and Go (Golang) are currently the most highly valued languages in this ecosystem.
  3. Are Certifications Worth It? Yes, especially to get past the initial HR screening. Certifications like the AWS Certified Solutions Architect – Associate or the CKA (Certified Kubernetes Administrator) carry massive weight in the global market.
  4. Build a Real Portfolio: Publish a project on GitHub where you provision infrastructure via Terraform, set up a CI/CD pipeline using GitHub Actions, and deploy a simple app to a Kubernetes cluster. Practical projects always beat theoretical resumes.

Essential References and Study Links

To stay up-to-date, we highly recommend following official organizations and annual market reports:


🚀 Want access to the best remote Cloud & DevOps jobs?

Join our mailing list and get the best jobs delivered straight to you, tailored to your areas of interest. Currently, we partner with over 200 companies that advertise their premium, remote-first roles with us. Sign up now and get the best opportunities in the global market right in your inbox!