Engineer - ML Quality Assurance

About Inception42

Inception42, part of the G42 group, stands as the region's foremost innovator in AI-powered products, ranging from domain-specific to industry-agnostic solutions, grounded in extensive research and development. Operating as the intelligence core within the G42 ecosystem, the company transforms data and computational infrastructure into practical AI applications, dedicated not only to commercial success but also to fostering positive societal change.

Role Overview

As an Engineer focused on Machine Learning Quality Assurance (ML QA), you will play a key role in crafting and implementing QA procedures that guarantee the precision, dependability, and efficiency of machine learning models and AI systems. Close collaboration with data scientists, software engineers, and product teams is essential to validate models and solutions, upholding rigorous quality standards for our AI initiatives.

Key Responsibilities

• Work alongside ML QA engineers to uphold top-tier product quality standards.
• Develop, implement, and manage comprehensive QA strategies for machine learning-based products and services.
• Partner with cross-functional teams including software developers, ML scientists, and product managers for coordinated quality assurance efforts.
• Create and execute manual and automated test plans to thoroughly evaluate systems.
• Assess AI chatbots and Retrieval-Augmented Generation (RAG) applications for response accuracy, relevance, reliability, hallucination issues, safety, and retrieval effectiveness.
• Utilize LLM-as-a-Judge methodologies and build automated evaluation pipelines using tools like DeepEval.
• Track and analyze ML QA metrics and present findings to senior leadership.
• Lead complex root cause analyses and problem-solving activities related to project issues.
• Stay informed about the latest QA tools, frameworks, and industry best practices and encourage their adoption within the QA team.
• Ensure adherence to both company and industry-wide quality standards.

Candidate Profile

• Possess a Bachelor’s degree in Computer Science, Engineering, or a related technical discipline.
• Have at least five years of experience in Quality Assurance, including a minimum of two years in a leadership capacity.
• Extensive familiarity with QA methodologies, tools, and processes.
• Good understanding of the lifecycle of machine learning products.
• Strong background in assessing data quality.
• Experience crafting clear, concise, and comprehensive test plans and cases.
• Knowledge of software development life cycle (SDLC) and agile project methodologies.
• Experience working with cloud service platforms and architectures.
• Excellent analytical and problem-solving abilities with keen attention to detail.
• Experience within health, finance, or climate sectors is advantageous.
• Strong communication skills, both written and verbal.

Technical Environment

• Programming Languages: Python, Java, SQL
• Testing Frameworks: Playwright, Selenium, JUnit, PyTest, Gatling, Postman, RestAssured
• LLM Evaluation Tools: DeepEval, LLM-as-a-Judge; validation of AI Chat and RAG applications
• Continuous Integration/Continuous Deployment: Jenkins, GitLab CI/CD
• Version Control: Git
• Cloud Platforms: Azure (optional AWS, Google Cloud Platform)
• Databases: MySQL, MongoDB, PostgreSQL
• Monitoring Tools: Grafana, Kibana
• Collaboration Tools: Jira, Confluence
• Other Technologies: Docker, Kubernetes

Why Join Inception42

Inception42 develops AI solutions designed for scalable and practical application across various industries and national infrastructure projects. Joining us means engaging closely with cutting-edge AI technologies and delivering real-world impact.