← Back to jobs

Senior Technical Program Manager, Machine Learning Infrastructure

cohere

Remoto Canada
AI Project Management Uncategorized

Job Score

100 pts
Remote model (+90) AI (+10) Project Management (+10)

Who are we?

Cohere is the leading security-first enterprise AI company. We build cutting-edge foundation AI models and end-to-end products that are designed to solve real-world business problems.

We’re training and deploying frontier models for enterprises who are building AI systems. We believe that our work is instrumental to the widespread adoption of AI and we are looking for folks that want to be part of that.

We obsess over what we build. Each one of us is responsible for contributing to increasing the capabilities of our models and the value they drive for our customers. Cohere is a team of researchers, engineers, designers, and more, who are all passionate about their craft.

We are a global technology company co-headquartered in Toronto and San Francisco, with key offices in London, New York City, Montreal, Seoul, Germany and Paris. Join us!

Why this role?

As Cohere continues to grow, the size and complexity of our programs has continued increasing over time. To help us manage this, we are looking to bring in exceptional Technical Program Managers (TPM) to manage this!

At Cohere, TPMs are pivotal to our success, being seen as operational experts specializing in cross-functional efforts. Great TPMs at Cohere are well-rounded, executing with precision at the tactical level, while partnering with senior leaders and shaping the big picture at a strategic level, and the opportunities are endless in growing the scale and impact of their work. Cohere’s TPMs are often described by their stakeholders as organized, execution-oriented, pragmatic, and adaptable to the needs of the company and the programs they lead.

As a reward for the depth and breadth of expertize that you bring to the table, you will get to work alongside some of the most talented engineers in the world on building cutting edge AI technology. No day will be the same as the one before, and the dynamic high growth environment will be absolutely perfect for anyone excited about solving novel problems, bringing structure to oftentimes chaotic and fast-paced environments, and ambitious about scaling their own impact and growth alongside the company!

Please note: While we are remote-first and accept candidates from all over the world, we are strongly prioritizing hiring for candidates in the Eastern Time (ET) timezone.

As a Technical Program Manager for Machine Learning Infrastructure, you will:

  • Manage the program portfolio covering inference, efficiency, serving, and endpoints to guarantee that Cohere’s infrastructure continues to scale for a rapidly expanding user base of internal and external users

  • Lead the end-to-end coordination and execution across the program, with a particular focus on cross-functional collaboration with Modeling and customer-facing teams

  • Identify pain points and establish processes to ensure that the team can focus on development, while meeting needs of internal and external users of the models, and improving engineering best practices

  • Build a strong culture around continuous improvement, such as liaising with incident management leads, ensuring that problems are accurately root caused, and that required fixes are provided in a timely manner

  • Manage various overlapping projects and programs, ruthlessly prioritizing asks, to ensure that the company’s top priorities are met

  • Collaborate with stakeholders across the company to set, track, and manage timelines, deliverables, budgets, and scope to ensure successful program execution

  • Deliver clear, timely, and consistent updates across engineering, leadership, and non–technical teams on the progress, plans, and incidents

  • Act as a strong tactical and strategic partner to the senior leads across your program, whether that be providing low-level tactical support or help answer high-level strategic problems that drives impact at the company-level.

You may be a good fit if you have:

  • 5+ years of Technical Program Management experience focusing on Machine Learning Infrastructure, specifically covering areas such as model inference, serving, efficiency, and endpoints design & implementation

  • In-depth technical knowledge around ML infrastructure design and implementation, as well as engineering best practices, supporting a balance of velocity and structure in rapidly growing organizations

  • Experience working in a chaotic, fast paced, low structure environment. We need an EPM who is pragmatic, can roll up their sleeves when needed, and can function at the tactical and strategic level to do whatever it takes to make Cohere’s models succeed

  • (optional, but strongly preferred) Have technical experience in a hands-on capacity. We don’t necessarily need someone who has been working hands-on in a technical role, but the programs are inherently extremely technical. You need to dive into the depths of internal systems, and develop a reputation as a subject matter expert who brings in engineering best practices and the right amount of structure to continuously improve the program

  • (optional, but preferred) Experience working with ML teams, and a working understanding of how machine learning models are built in order to advocate for both the needs of the infrastructure teams and modeling teams in building scalable, highly performant ML infrastructure.

If some of the above - other than the ML Infrastructure experience - doesn’t line up perfectly with your experience, we still encourage you to apply! If you consider yourself a thoughtful worker, a lifelong learner, and a kind and playful team member, Cohere is the place for you.

We welcome applicants of all kinds and are committed to providing both an equal opportunity process and work environment. We value and celebrate diversity and strive to create an inclusive work environment for all.

Full-Time Employees at Cohere enjoy these Perks:

  • A weekly lunch stipend of $75/£75 or equivalent in your local currency for lunch.

  • Full health and dental benefits, including a separate budget for mental health.

  • RRSP matching, 401K, Pension Scheme.

  • 100% Parental Leave top-up for up to 6 months, for either parent.

  • Annual enrichment benefits:

    Arts & culture, fitness/wellness, quality time, and a workspace improvement credit.

    Education & learning stipend for conferences, courses, and coaching.

  • 6 weeks of paid vacation (30 working days!)

  • Budget for traveling to other offices if you are remote, plus an annual company offsite.

How and Where We Work:

  • Cohere is remote-friendly. We have offices in Toronto, San Francisco, New York City, London, Paris, Montreal, and more coming soon.

  • For those in the office: a daily lunch program, plenty of snacks, and regular community and social events.

  • For those not near an office: a co-working benefit so you can work alongside others in your city.

  • Everyone receives a $500 home office stipend to set up your workspace properly.

If any of the above doesn’t line up exactly with your experience, we still encourage you to apply.


We strive to create an inclusive work environment for all; we welcome applicants from all backgrounds and are committed to providing equal opportunities. Should you require any accommodations during the recruitment process, please submit an Accommodations Request Form, and we will work together to meet your needs.

We may use AI-enabled tools to screen and assess applicants against the criteria for this position. This helps our recruiters identify potentially qualified candidates, but it doesn't limit the applications our recruiters may review or consider.

About Artificial Intelligence

Artificial Intelligence is currently the fastest-growing field in the technology market. The revolution in generative models (GPT, Claude, Gemini) has created massive demand for AI-specialized professionals.

Key areas of practice include Machine Learning Engineering, MLOps, Prompt Engineering, AI Research, and Applied AI. Python, TensorFlow, PyTorch, and LLM knowledge are essential skills.

AI salaries are the highest in the technology sector, with many remote work opportunities at international companies.

About Project Management

Project Management is essential to ensure strategic initiatives are delivered on time, within scope, and with quality. PM professionals coordinate teams, manage risks, and communicate with stakeholders.

Key methodologies include PMBOK, PRINCE2, Scrum, and Kanban. Tools like Jira, Asana, Monday, and MS Project are widely used in daily work.

Certifications like PMP and PgMP are important differentiators in the market, with growing demand in technology and consulting companies.

Discover Other Areas

Understand the scope of work, key skills, and tools used in different career areas.

About Infrastructure and DevOps

Infrastructure and DevOps are responsible for creating, maintaining, and optimizing IT environments that support applications at scale. This area is fundamental for system reliability and performance.

Key technologies include AWS, GCP, Azure, Docker, Kubernetes, Terraform, Ansible, CI/CD (GitHub Actions, GitLab CI, Jenkins), and monitoring (Datadog, Grafana, Prometheus).

DevOps engineers and SREs are highly sought-after professionals, with salaries among the highest in the technology sector.

About UI Design

The User Interface (UI) Design area focuses on creating and designing all the visual elements that users interact with in a digital product. This includes screens, buttons, icons, typography, color palettes, and responsive layouts, ensuring an aesthetically pleasing, consistent, and easy-to-use interface. Skills in tools like Figma and knowledge of design systems are essential.

About Product Owner

The Product Owner (PO) is the professional responsible for maximizing the value of the product delivered by the development team. They act as the voice of the customer and stakeholders, managing and prioritizing the product backlog, defining clear user stories, and ensuring the team works on the most valuable items for the business.

Key skills include backlog management, user story writing, prioritization (Mascow, RICE), agile methodologies (Scrum, Kanban), and stakeholder communication. Knowledge of tools like Jira, Trello, Azure DevOps, and Miro is essential.

Product Owners are highly sought-after professionals in the technology market, working collaboratively with Scrum Masters, Product Managers, and engineering teams to drive agility and continuous value delivery.

About Communications

The Communications area is strategic for building and maintaining a company's institutional image. It encompasses corporate, internal, and external communication, public relations, press office, and reputation management. Communications professionals are responsible for delivering consistent messages that strengthen the employer brand and market positioning.

Key skills include strategic writing, communication planning, crisis management, media relations, corporate content production, event organization, and digital communication. Knowledge of communication CRMs, press release distribution platforms, and media monitoring tools (Meltwater, Cision) is a differentiator.

Corporate communicators in technology companies are highly valued, especially those who master change communication, employee engagement, and digital communication. The field offers opportunities in startups, scale-ups, and large corporations, with a focus on storytelling, organizational culture, and innovation communication.

About Office Suite

Proficiency in Office Suite is an essential skill for professionals across various areas. Microsoft Excel, Word, PowerPoint, and Outlook are fundamental tools in the corporate day-to-day, while Google Workspace and other collaborative solutions are gaining increasing space.

Key skills include advanced Excel (formulas, pivot tables, Power Query, VBA/Macros), Word (formatting, mail merge, styles), PowerPoint (presentation design, animations), Outlook (email and calendar management), and collaborative tools like Google Sheets, Notion, and Airtable.

Professionals with advanced Office Suite proficiency are valued in administrative, financial, data, and operational areas. Microsoft Office Specialist (MOS) certifications are important differentiators. The combination of advanced Excel with data analysis skills is one of the most in-demand competencies in the market.

Career Guides

Technology Career Guide

Planning, skills, interviews, and professional growth in IT, Data Science, DevOps, and Product.

Read full guide →

Design Career Guide

UX/UI, Graphic Design, Product Design. Portfolio, tools, interviews, and growth in the Design field.

Read full guide →

Marketing Career Guide

SEO, Paid Media, Growth, Content Marketing. Certifications, tools, and strategies to grow in Digital Marketing.

Read full guide →

Finance Career Guide

Financial market, investments, corporate finance, certifications, and strategies to grow in the financial field.

Read full guide →

Communication Career Guide

Journalism, PR, Corporate Communication, Content Marketing, and Multimedia Production.

Read full guide →

Administration Career Guide

Business Management, HR, Logistics, Consulting, Project Management, and Entrepreneurship.

Read full guide →

Data Career Guide

Data Science, Data Engineering, BI, Machine Learning, and AI. From training to the job market.

Read full guide →

Product Career Guide

Product Management, Product Ownership, Agile, Scrum, and OKRs. From strategy to execution.

Read full guide →

Expert Tip

Generative Design and AI as a Co-pilot

If the last decade in digital design was defined by mobile standardization and UX/UI becoming the core of product development, 2026 marks the dawn of a new era. We are no longer designing just for flat glass screens; we are building intelligent ecosystems, three-dimensional environments, and autonomous algorithms.

For designers looking to stand out and secure the best six-figure remote opportunities in the US tech market, understanding where the industry is heading is no longer a "nice-to-have" differential—it's a matter of professional survival. Below, we break down the four major trends that will dictate hiring and compensation in the 2026 design landscape.

1. Generative Design and AI as a Co-pilot (Not a Replacement)

The fear of Artificial Intelligence replacing designers is officially in the past. In 2026, generative AI is deeply and natively integrated into industry-standard tools like Figma, Adobe, and Framer. The most valued skill by top-tier tech companies is no longer speed in aligning components, but rather algorithmic art direction and prompt design.

  • UI Automation: Wireframing, component variations, and complex design systems can now be generated with a few text prompts.
  • The Designer's New Role: Professionals are shifting from operational executors to curators and strategists, ensuring that AI-generated outputs align with user psychology and core business objectives.

2. Spatial Design and Spatial Computing

With the maturation of mixed reality devices (such as the Apple Vision Pro and Meta's advanced lineups), Spatial Design has evolved from an experimental niche to a mandatory department in Big Tech and forward-thinking startups.

Designing for spatial computing requires a complete paradigm shift: designers must understand Z-axis depth, visual ergonomics, spatial audio, and interactions based on eye-tracking and hand gestures. Roles like AR/VR Product Designer and 3D Interaction Designer are seeing an exponential jump in job listings, often paired with premium compensation packages.

3. Conversation Design and Invisible Interfaces (Zero-UI)

Driven by the omnipresence of Large Language Models (LLMs), the way users interact with systems has fundamentally changed. In 2026, many of the best interfaces don't rely on buttons or hamburger menus; they are conversational. UX Writing and Conversation Design have taken center stage.

  • The Challenge: How do you design the "personality" and flow of a virtual assistant so it feels natural, empathetic, and on-brand, rather than like a rigid robot?
  • The Opportunity: Designers who know how to map complex decision trees, create logical flows for voice and text, and train the empathy of AI models are being heavily scouted by top US startups.

4. Digital Sustainability and Eco-Design

The ESG (Environmental, Social, and Governance) agenda has finally reached the product design tables. The internet consumes a massive amount of energy, and in 2026, tech companies are being strictly held accountable for their digital carbon footprint.

Enter the demand for Digital Eco-Design. This involves creating lighter interfaces, optimizing user flows to reduce screen time (saving battery life and server processing power), and adopting color palettes and assets (like SVGs instead of heavy raster images) that require less energy to render. Being a sustainable designer has become a powerful B2B selling point for agencies and freelancers alike.

Conclusion: The Evolution of Talent

The 2026 design market is highly rewarding for those who embrace complexity. The barrier to entry for making "pretty screens" has dropped significantly, but the demand for professionals who can solve intricate business problems through empathy, strategy, and the mastery of new technologies has never been higher.

If you want to stay ahead of the curve and get direct access to the remote jobs that are actively looking for these specific skills, make sure to follow Mondywork's daily curation. The future of design is hybrid, remote, and full of opportunities.