AI Infrastructure Engineer

About Fin

Fin is a pioneering AI Customer Agent company dedicated to enabling businesses to deliver flawless customer experiences. Their proprietary AI agent handles comprehensive customer service across all channels, ranging from sales to support and ecommerce, with minimal setup. Founded in 2011, Fin is among the fastest-growing private software firms worldwide, serving around 30,000 businesses globally.

Role Overview

The company seeks Senior+ AI Infrastructure Engineers to develop and enhance the systems that train and deploy Fin's AI products. This role involves working closely with GPU-level programming and scaling model training and inference pipelines for cutting-edge models like Fin Apex, which excels in customer service tasks.

Key Responsibilities

• Develop and scale training workflows for large transformer and LLM models, covering data processing to distributed training and evaluation.
• Create and optimize inference services to provide low-latency, reliable customer experiences, including autoscaling and routing mechanisms.
• Tune GPU-level performance by refining kernels, boosting utilization, and identifying bottlenecks within training and inference elements.
• Collaborate with machine learning scientists to translate advanced training and inference techniques into production.
• Participate actively in recruitment, mentoring, and skill development within the engineering team.
• Enhance technical standards, reliability, and operational excellence across the AI platform.

Candidate Profile

• Minimum 5 years of software engineering experience with a solid history of delivering high-quality products or platforms.
• Degree in Computer Science, Computer Engineering, or comparable expertise demonstrating strong fundamentals.
• Hands-on experience in one or more areas: model training (especially transformers and LLMs), model inference at scale, or low-level GPU programming such as CUDA or Triton.
• Proficient in operating production environments involving significant traffic, data, or organizational scale.
• Effective communicator capable of explaining complex technical issues to diverse audiences.
• Dedicated to maintaining strong technical skills, continuous learning, and rapid adaptation to new technologies.
• Deep knowledge of at least one programming language like Python, Ruby, Java, or Go, emphasizing clean and reliable coding practices.

Additional Advantages

• Experience at AI-centric companies handling proprietary model training or inference.
• Familiarity with Kubernetes for operational workloads.
• Exposure to AWS or other leading cloud platforms.
• Python expertise in machine learning or infrastructure roles.
• Active engagement in technology communities through projects, open source, meetups, or content sharing.

Work Environment and Culture

Fin supports hybrid work, expecting employees on-site at least three days weekly to foster collaboration and culture while allowing flexible remote time. The company emphasizes an open, respectful culture that deliberately refrains from engaging in divisive social or political matters during work communications, promoting unity through shared values and outstanding work.

Diversity and Inclusion Policy

Committed to Equal Employment Opportunity, Fin prohibits discrimination based on legally protected characteristics including but not limited to race, gender, disability, and veteran status.