Senior Technical Program Manager - Machine Learning Infrastructure

About Cohere

Cohere is a forefront enterprise AI company focused on security, developing advanced foundational AI models and comprehensive products aimed at solving tangible business challenges. Our team comprises researchers, engineers, and designers passionate about evolving model capabilities and delivering immense value to our clients. While headquartered in Toronto, we maintain key offices globally, including London, New York City, San Francisco, Montreal, Paris, Berlin, and Seoul.

Role Overview

As Cohere expands, the complexity and size of our programs grow accordingly. We seek an exceptional Technical Program Manager (TPM) experienced in machine learning infrastructure to oversee these critical programs. TPMs at Cohere are vital, recognized as operational specialists managing cross-functional projects with precision, collaborating with senior leadership strategically, and scaling their influence and contributions continuously.

Responsibilities

• Oversee a portfolio of programs spanning inference, model efficiency, serving infrastructure, and endpoint management to ensure scalable infrastructure supporting a rapidly growing user base.
• Coordinate and execute program activities end-to-end, fostering strong collaboration with Modeling and customer engagement teams.
• Detect operational challenges and establish streamlined processes that allow engineering teams to focus on development while addressing the needs of both internal and external stakeholders, simultaneously enhancing engineering best practices.
• Promote a culture of continual improvement through partnerships with incident management leads, ensuring accurate root cause analysis and timely resolution of issues.
• Manage multiple overlapping projects by prioritizing effectively to align with the company's highest-level objectives.
• Collaborate with cross-company stakeholders to plan, monitor, and manage timelines, deliverables, budgets, and project scope for effective program delivery.
• Provide clear, regular updates on progress, plans, and incidents to engineering teams, leadership, and non-technical stakeholders.
• Serve as a trusted tactical and strategic collaborator to senior leaders, providing detailed support and addressing high-level strategic challenges to drive company-wide impact.

Qualifications

• At least five years of experience in Technical Program Management focused on machine learning infrastructure, including expertise in model inference, serving systems, efficiency, and endpoint strategies.
• Deep technical understanding of ML infrastructure architecture and engineering best practices, balancing development speed and structural rigor in fast-paced, scaling environments.
• Proven ability to thrive in dynamic, fast-moving, and sometimes unstructured settings, with a pragmatic approach, readiness to engage hands-on when needed, and competency at both strategic and operational levels.
• Preferred (though optional): Hands-on technical background facilitating in-depth understanding of internal systems, enabling you to emerge as a subject matter expert and champion continuous process enhancement.
• Preferred (though optional): Prior experience working with machine learning teams and foundational knowledge of ML model creation, aiding advocacy for infrastructure and modeling team integration to develop scalable, high-performance ML systems.

Culture and Values

If your background doesn't perfectly match every qualification aside from machine learning infrastructure experience, we still encourage your application. We seek thoughtful, lifelong learners who value kindness, playfulness, and teamwork. Cohere is committed to diversity, equity, inclusion, and providing an accessible and welcoming workplace for all.

Benefits

• Weekly lunch stipend equivalent to $75/£75 or local currency.
• Comprehensive health and dental coverage, including dedicated mental health funding.
• Retirement plans including RRSP matching, 401(k), or pension schemes.
• Full parental leave top-up for up to six months for any parent.
• Annual enrichment allowances covering arts, culture, fitness, quality time, and workspace improvements.
• Learning stipends for conferences, courses, and coaching.
• Generous paid time off: six weeks (30 working days) per year.
• Travel budget for visits to other offices and participation in annual company offsites.

Work Environment

• Cohere operates as a remote-friendly workplace with offices in major global cities.
• In-office employees enjoy daily lunches, snacks, and frequent community and social events.
• Remote workers can access coworking benefits to collaborate with local peers.
• Each employee receives a $500 home office setup stipend.

Diversity and Inclusion

Cohere embraces diversity and is committed to equal opportunity hiring and maintaining an inclusive work environment. We offer accommodations upon request during the recruitment process to ensure access for all candidates.

Important Notes

We prioritize candidates in the Eastern Time zone though welcome applications globally. AI-assisted tools may support candidate screening without limiting recruiter discretion. Beware of scams: official communications come only from company email domains and authorized platforms.