← Back to jobs

Engineering Manager, Ai Platform

harvey

San Francisco
Engineering AI

Job Score

90 pts
On-site model (+70) Engineering (+10) AI (+10)

Why Harvey

At Harvey, we’re transforming how legal and professional services operate. By combining frontier agentic AI, an enterprise-grade platform, and deep domain expertise, we’re reshaping how critical knowledge work gets done for decades to come.

This is a rare chance to help build a generational company at a true inflection point. We have strong product-market fit and world-class investor support. We’re scaling fast and defining a new category in real time. The work is ambitious, the bar is high, and the opportunity for growth — personal, professional, and financial — is unmatched.

Our team moves fast, takes ownership, and is deeply committed to the mission — operating with intensity, staying close to our customers, and pushing each other for excellence. We live by three values: Decisiveness, Simplicity, and Job's Not Finished. We act quickly on clear judgment over perfect information, we believe simplicity is what scales, and we're never satisfied with where we are. If you want to do the best work of your career alongside people who share that drive, we'd love to build with you.

At Harvey, the future of professional services is being written today — and we’re just getting started.

Role Overview

Harvey is redefining what’s possible in legal work by combining cutting-edge AI with intuitive product experiences. As we scale rapidly and take on increasingly complex use cases, we’re expanding our engineering team to accelerate our ability to ship fast, delight users, and build infrastructure that scales with us.

As an Engineering Manager for AI Platform, you will lead a team of engineers building the horizontal systems that make Harvey’s AI products higher quality, faster, and more cost-efficient. This includes eval and simulation infrastructure, model routing, open-source and post-trained model serving, new-model rollouts, and the document processing systems (OCR, embeddings, retrieval, and citations) that turn any file a lawyer gives us into something Harvey can read, find, and cite. You will partner with Product, Research, and product engineering teams to turn fast-moving advances in applied AI into durable, reusable platform capabilities. You will also set the technical direction for how teams across Harvey build, test, and ship AI features.

This role is equal parts technical depth and product intuition. You’ll be trusted to make fast, high-quality decisions, work at the cutting edge of applied AI, and grow a team that embodies engineering excellence.

We move with urgency, bias toward simplicity, and expect our leaders to be hands-on when needed. If you’re energized by ownership, decisive execution, and solving real user problems, we’d love to hear from you.

What You'll Do

  • Lead and grow a team of engineers building the core AI platform that powers Harvey’s products

  • Define the roadmap for shared AI infrastructure, including model routing, open-source and post-trained model serving, eval and simulation infrastructure, and large-scale document processing, embeddings, retrieval, search and citation systems

  • Partner with Product, Research, Agent Platform, and product engineering teams to understand their needs and turn recurring patterns into reusable, well-documented platform primitives

  • Build and scale offline eval and simulation infrastructure so teams can measure quality, catch regressions, and ship AI changes with confidence

  • Drive reliability, latency, cost efficiency, and security across LLM-powered systems, including working with commercial and open-source model providers on capacity, rate limits, and new capabilities

  • Evaluate and rapidly adopt new models, frameworks, and techniques, and decide what to build, buy, or adopt

  • Contribute to code and architecture reviews, unblock teams, and lead by example when needed

  • Hire, grow, and retain exceptional engineers who thrive in a high-trust, high-impact environment

What You Have

  • 2+ years of experience in a tech-lead/software engineering management role leading ML/AI engineering teams, preferably in high-growth environments

  • 5+ years of experience as a backend, infrastructure or ML/AI engineer

  • A track record of leading high-performing, engaged engineering teams

  • Experience building and operating production systems powered by LLMs (for example agents, retrieval, tool use, or evaluation pipelines)

  • Experience building internal platforms or shared services that other engineering teams depend on, and partnering with cross-functional stakeholders to prioritize them

  • Strong backend engineering skills in modern languages and framework and familiarity with distributed systems concepts

  • Sound judgment on tradeoffs among quality, latency, cost, and speed of delivery in AI systems

  • A plus: Experience with open-source model inference and serving, large-scale document processing, search, and retrieval systems, LLM observability and eval tooling, or working directly with foundation model providers

Compensation

$272,000 - $355,000 USD

Depending on your location, an Applicant Privacy Notice may apply to you. You can find all of our Applicant Privacy Notices here.

#LI-AP1

Harvey is an equal opportunity employer and does not discriminate on the basis of race, gender, sexual orientation, gender identity/expression, national origin, disability, age, genetic information, veteran status, marital status, pregnancy or related condition, or any other basis protected by law.

We are committed to providing reasonable accommodations to applicants with disabilities, and requests can be made by emailing accommodations@harvey.ai

What did you think of this job?

Comments 0

Want to leave a comment?
Sign in or create your account in seconds to join the discussion.
Loading comments...

About Engineering

Software Engineering goes beyond traditional development, focusing on scalability, performance, and system architecture. Software engineers are responsible for designing infrastructures that support millions of simultaneous users.

Skills include microservices architecture, DevOps, cloud computing, application security, and performance optimization. Knowledge of containerization (Docker, Kubernetes) and CI/CD is increasingly required.

Senior software engineers are rare and highly compensated professionals, with opportunities at major global tech companies.

About Artificial Intelligence

Artificial Intelligence is currently the fastest-growing field in the technology market. The revolution in generative models (GPT, Claude, Gemini) has created massive demand for AI-specialized professionals.

Key areas of practice include Machine Learning Engineering, MLOps, Prompt Engineering, AI Research, and Applied AI. Python, TensorFlow, PyTorch, and LLM knowledge are essential skills.

AI salaries are the highest in the technology sector, with many remote work opportunities at international companies.

Discover Other Areas

Understand the scope of work, key skills, and tools used in different career areas.

About Web Designer

The Web Designer is the professional responsible for creating visual interfaces for websites, web applications, and landing pages, combining aesthetics, usability, and user experience. They transform business needs into functional and responsive layouts that communicate brand identity.

Key skills include UI design, responsive design, prototyping (Figma, Sketch, Adobe XD), wireframing, design systems, accessibility (WCAG), information architecture, and basic HTML/CSS knowledge. Knowledge of UX design, motion design, and front-end is a differentiator.

Web Designers in technology companies are highly valued, especially those who master design systems, design tokens, and can create interfaces that convert and engage. The field offers opportunities from junior web designer to product designer and design lead.

About SEO Analyst

The SEO Analyst is the professional responsible for optimizing websites for search engines, increasing organic visibility and qualified traffic. With the growing importance of digital marketing, SEO professionals are fundamental to any online presence strategy.

Key skills include on-page and off-page SEO, technical SEO, keyword research, SEO audits, link building, optimized content creation, and metrics analysis. Tools like Google Search Console, Google Analytics, Ahrefs, Semrush, Moz, and Screaming Frog are essential for daily work.

SEO analysts in technology companies are highly valued, especially those who master technical SEO, Core Web Vitals, and data-driven content strategies. The field offers opportunities from junior analyst to head of SEO, with a focus on organic growth, domain authority, and return on investment.

About Customer Service

The Customer Service / Client Relations area is essential for ensuring customer satisfaction, retention, and a good relationship. Professionals in this field are the primary interface for communication, handling inquiries, requests, feedback, and ensuring a high-quality day-to-day experience. Skills in communication, problem-solving, empathy, and patience are indispensable.

About Design

The Design field, especially UX/UI and Product Design, has experienced significant growth in recent years. With accelerated business digitization, the demand for professionals who can create intuitive and pleasant digital experiences has never been higher.

Key skills include Figma, Sketch, Adobe XD, user research, design thinking, prototyping, and system design. Product designers are increasingly valued for their direct impact on business results.

Remote work has opened doors for Brazilian designers to work for global companies, with competitive salaries in dollars and euros.

About Ecommerce Manager

The Ecommerce Manager is the professional responsible for the entire strategic and operational management of online stores and marketplaces. They lead teams, define pricing, promotion, and catalog strategies, and monitor online sales performance across multiple platforms.

Key skills include catalog management, dynamic pricing, seasonal campaigns (Black Friday, Cyber Monday), marketplace management (Amazon, Mercado Livre, Shopee, Magalu), paid traffic, CRO, and team management. Knowledge of Shopify, VTEX, WooCommerce, Google Ads, Meta Ads, and performance metrics is a differentiator.

Ecommerce Managers in technology companies are highly valued, especially those who master multi-marketplace management, checkout optimization, and mobile commerce strategies. The field offers opportunities from ecommerce manager to head of ecommerce, with a focus on revenue, customer experience, and growth.

Career Guides

Technology Career Guide

Planning, skills, interviews, and professional growth in IT, Data Science, DevOps, and Product.

Read full guide →

Design Career Guide

UX/UI, Graphic Design, Product Design. Portfolio, tools, interviews, and growth in the Design field.

Read full guide →

Marketing Career Guide

SEO, Paid Media, Growth, Content Marketing. Certifications, tools, and strategies to grow in Digital Marketing.

Read full guide →

Finance Career Guide

Financial market, investments, corporate finance, certifications, and strategies to grow in the financial field.

Read full guide →

Communication Career Guide

Journalism, PR, Corporate Communication, Content Marketing, and Multimedia Production.

Read full guide →

Administration Career Guide

Business Management, HR, Logistics, Consulting, Project Management, and Entrepreneurship.

Read full guide →

Data Career Guide

Data Science, Data Engineering, BI, Machine Learning, and AI. From training to the job market.

Read full guide →

Product Career Guide

Product Management, Product Ownership, Agile, Scrum, and OKRs. From strategy to execution.

Read full guide →

Tech & Remote Glossary

Stop getting lost in interviews and job descriptions

The job market, especially within tech and global companies, has developed its own dialect. Not understanding these acronyms can make you lose valuable opportunities or poorly negotiate your contract. To end this problem, we created the Definitive Glossary for the Remote Professional.

🏢 Work Models & Routine

Async (Asynchronous Work)
A communication model where responses don't need to be immediate. Instead of back-to-back meetings, the team relies on well-structured documents, threads, and messages. It's the gold standard for global companies spanning multiple time zones.
Sync (Synchronous Work)
The opposite of Async. It requires the team to be online and available at the same time for meetings, live chats, and real-time collaboration.
Daily / Stand-up
A quick daily meeting (usually 15 minutes) common in Agile (Scrum) methodologies. The team answers three questions: What did I do yesterday? What will I do today? Are there any blockers?
All-Hands / Town Hall
A company-wide meeting involving all employees. Usually led by the founders (C-Levels) to present results, new goals, and answer team questions.
1:1 (One-on-One)
A recurring individual meeting between a professional and their direct manager. It is used for career alignment, feedback, and problem-solving, not just for project status updates.

💰 Contracts, Benefits & Compensation

PTO (Paid Time Off)
Instead of strict, categorized leave policies, modern US companies usually offer a flexible pool of days (e.g., 20 days of PTO, or even "Unlimited PTO") that you can use for vacations, sick days, or personal matters, while receiving your regular compensation.
Equity / Stock Options
Company ownership. The startup offers you the right to buy shares at a heavily discounted strike price in the future. If the company grows, goes public, or is acquired, these shares can be highly lucrative.
Vesting (Vesting Schedule)
The rule that controls your Equity. It usually lasts 4 years. You don't get all the shares on day one; you "earn" them gradually as you stay with the company. A "1-year Cliff" means you must stay for at least one year to receive your first batch of shares.
RSUs (Restricted Stock Units)
Unlike Stock Options (where you have the right to buy the stock), RSUs are actual shares the company grants you as a bonus or part of your compensation package, following a strict Vesting schedule.
Independent Contractor (1099 / B2B)
The most common international hiring model for global talent working for US companies. You act as a service provider (business-to-business), receiving the gross salary (often six-figure compensation) without standard local payroll tax deductions at the source.

🤖 Recruitment & Hiring Process

ATS (Applicant Tracking System)
The "robot" that reads your resume. Software like Greenhouse, Ashby, and Workday are used to filter candidates by keywords before a human even looks at the document. (Pro tip: this is why your resume must be clean, semantic, and have the right keywords).
JD (Job Description)
The document that lists the responsibilities, technical requirements, and benefits of the open position.
Cultural Fit
The interview stage that evaluates if your core values, communication style, and worldview align with the company's culture. This is the ultimate test of your Soft Skills.
Onboarding
The integration process. It's the period of your first few weeks at the company, where you get your access credentials, learn about the culture, study the internal documentation, and understand how the product works.

🚀 How to use this to your advantage?

The secret isn't just knowing what these acronyms mean, but using them actively. If during an interview for a premium tech role you ask, "How does your PTO policy and Vesting schedule work?", the recruiter will immediately perceive you as a high-level professional, familiar with the global market standards.

The remote job market requires preparation. And having the right vocabulary is the first big step to securing six-figure proposals and standing out among thousands of applicants.

Expert Tip

Landing Top-Tier Traffic Analyst and SEO Roles

The New Era of Performance Marketing

The digital marketing landscape has undergone a radical transformation in recent years. The era of the "button pusher" who merely launched Meta Ads campaigns or stuffed keywords into WordPress is officially over. Today, companies—especially top-tier US startups and global tech corporations offering six-figure compensations—are looking for analytical, Growth-focused, and highly Data-Driven professionals.

Whether managing multi-million dollar paid media budgets or optimizing site architecture for the new AI-driven search engines, the Traffic and SEO Analyst has become the engine of predictable revenue for tech companies worldwide.

1. Technical SEO and the AI Revolution (SGE)

With Google's introduction of the Search Generative Experience (SGE), SEO is no longer just about backlinks and search volume. It now requires a deep understanding of search intent and topical authority.

What Tech Recruiters are looking for:

  • Technical SEO Mastery: The ability to analyze Core Web Vitals, manage Crawl Budgets, and optimize JavaScript rendering (a critical factor for modern frameworks like React and Next.js).
  • Advanced Data Analysis: Fluency in enterprise tools such as Screaming Frog, Semrush, Ahrefs, and Google Search Console.
  • Focus on E-E-A-T: Experience, Expertise, Authoritativeness, and Trustworthiness. Understanding how to structure content so that Google's algorithm recognizes it as a reliable primary source.
"Modern SEO success requires you to stop optimizing for algorithms and start optimizing for the user journey, using technical data to remove any friction along the way." — Google Search Central Guidelines

2. Paid Traffic: From Operational to Strategic

In the realm of paid media (Google Ads, Meta Ads, LinkedIn Ads, TikTok Ads), platform automation handles most of the bidding work (Smart Bidding). The modern candidate's competitive edge lies in acquisition strategy and financial viability analysis.

Metrics you must master for your interviews:

  1. CAC (Customer Acquisition Cost): Moving beyond Cost Per Click (CPC). Understanding exactly how much it costs to acquire a paying user.
  2. LTV (Lifetime Value): Knowing how to cross-reference acquisition costs with the value a customer brings to the company over time (LTV:CAC ratio).
  3. ROAS vs. ROI: Grasping the crucial difference between the direct return on ad spend (ROAS) and the actual return on investment for the entire business (ROI).
  4. Server-Side Tracking: With the deprecation of third-party cookies, mastering the Conversions API and Google Tag Manager (GTM) Server-Side is a massive senior requirement.

3. Building an Unbeatable Portfolio

In the global remote market, degrees matter far less than proven results. Your portfolio shouldn't just be a resume; it should be a comprehensive document of Case Studies.

Structure your cases using the STAR method:

  • Situation: What was the baseline? E.g., "The e-commerce brand was burning $10k/month with a 1.2 ROAS."
  • Task: What was the goal? E.g., "Reduce CPA by 30% and increase non-branded organic traffic."
  • Action: What did YOU do technically? E.g., "Audited GTM, restructured PMax campaigns, and applied Schema markup in the HTML."
  • Result: The numerical impact. E.g., "Scaled ROAS to 3.8 and grew organic traffic by 45% in 3 months."

4. Certifications That Actually Open Doors

If you want to bypass strict Applicant Tracking Systems (ATS) like Greenhouse or Workday, ensure your LinkedIn and resume feature official certifications issued by the tech platforms themselves:

References and Must-Reads

To stay relevant in a market that changes weekly, we highly recommend following these official sources:

  1. Official Google Search Central Documentation.
  2. Annual State of Marketing Reports from HubSpot and Semrush.
  3. Technical articles focused on Data-Driven Marketing from the Harvard Business Review.

© 2026 Mondywork. Empowering career evolution in Tech, Design, and Digital Marketing.