Forward Deployed Engineer

About the Role

We are seeking experienced AI-focused Forward Deployed Engineers to join a leading global IT service provider based in Bangalore or Chennai. The ideal candidate will possess over eight years of expertise in AI model optimization, fine-tuning, and strategic implementation, pushing AI models to their full potential in specialized client contexts.

Key Responsibilities

• Conduct advanced fine-tuning of AI models using techniques like PEFT (Parameter-Efficient Fine-Tuning), LoRA, and QLoRA to adapt open-source models such as Llama 3 and Mistral to particular client domains.
• Optimize AI models through quantization procedures to minimize inference latency and computational costs without degrading performance.
• Manage dense vector representations and embedding optimizations to enhance model efficiency.
• Stay abreast of cutting-edge developments in AI, including State Space Models and Long-Context optimizations, and apply these advancements to improve client solutions.
• Serve as a strategic advisor to C-level executives, illustrating the potential of AI technologies and shaping long-term AI strategy and roadmaps for clients.

Technical Skills and Expertise

• Proficiency in deep learning frameworks such as PyTorch and TensorFlow.
• Comprehensive understanding of transformer architectures, including attention mechanisms.
• Experience in Model Ops with capabilities in serving custom models using platforms like vLLM and Text Generation Inference (TGI).
• Expertise in GPU memory management and advanced quantization techniques (e.g., GGUF, AWQ).
• Knowledge of advanced data handling including curation of training datasets, synthetic data generation, and reinforcement learning from human feedback (RLHF) methodologies.

Leadership and Culture

Lead and foster the technical culture within the Forward Deployed Engineer (FDE) organization by defining standards and guiding technical directions.