Data Platform Engineer with Terraform and AWS (Remote Contract)

Role Overview

This fully remote contractor position spans an initial 12-month term with a likely extension or continuation. The working schedule aligns mainly with Indian Standard Time (IST) Monday to Friday, including some required overlap for standup meetings one or two days a week, with flexibility subject to team agreement.

Primary Responsibilities

The role involves supporting the design, construction, automation, and continual improvement of Calance's CG data platform. The main technology focus areas include Astronomer Astro (Apache Airflow), Databricks, AWS infrastructure, and platform automation components. The engineer will manage platform engineering tasks such as environment setup, job and DAG deployment, cluster management, and integration automation.

Key Tasks and Expertise

• Develop and maintain Python scripts for platform automation and integration.
• Manage and deploy Apache Airflow (Astronomer Astro) DAGs, configure environments, and provide ongoing operational maintenance.
• Administer and integrate Databricks features, including workspace setup, job scheduling, cluster management, notebooks, the Unity Catalog, and platform connectivity.
• Utilize AWS core services effectively, focusing on IAM, EKS, S3, Secrets Manager, Lambda, CloudWatch, networking, and cross-account integrations.
• Implement Infrastructure as Code (IaC) using Terraform to provision and manage cloud and platform resources.
• Deploy and maintain CI/CD pipelines and automation tools like Harness or equivalent solutions.
• Design and support self-service platform capabilities and reusable patterns for application and data teams.
• Uphold cloud security best practices, including IAM role management, secret handling, and governance controls.
• Troubleshoot across infrastructure, platform, deployment, and integration layers effectively.
• Work with REST APIs, SDKs, and automation frameworks to enable streamlined platform workflows.
• Adhere to Git workflows including code reviews, branching strategies, and release management.
• Create clear technical documentation, runbooks, and reusable implementation patterns.
• Collaborate closely with onshore architects, client stakeholders, and engineering peers through strong communication skills.

Required Qualifications and Experience

• Strong experience in Python programming for platform engineering and automation.
• Hands-on expertise with Apache Airflow/Astronomer Astro including DAG development, deployment, and operational support.
• Proficient with Databricks administration and integration capabilities.
• Solid knowledge of AWS cloud services and infrastructure, especially IAM, EKS, S3, Secrets Manager, Lambda, CloudWatch, and networking.
• Proven skills with Infrastructure as Code using Terraform.
• Experience with CI/CD tools and pipeline automation like Harness.
• Understanding of cloud security, enterprise governance, and multi-account AWS integrations.
• Ability to troubleshoot complex platform and integration issues.
• Competence in Git-based development processes and release management.
• Excellent collaborative and communication abilities.

Additional Information

• This is a full-time contract position, conducted remotely with schedule flexibility around IST time zone.
• The contract duration is initially 12 months, with potential for extension or becoming ongoing.
• Applicants should be able to attend occasional team stand-ups requiring evening availability in IST.

Eligibility

Open to any graduate interested in this contract role supporting cloud-based data platform engineering.