Lead Data Engineer (Azure Databricks)
Wellington, Wellington Region, New Zealand · Full Time
Be the first to apply
- Experience
- 5+ yrs
- Salary
- —
- Openings
- 1
- Posted
- 13 કલાક પેહલા
- Work mode
- In office
- Education
- Bachelor Degree
- Eligibility
- Applicants must be legally entitled to work in New Zealand at the time of application.
- Resume
- Required to apply
Where you'll work
Sign in to tell us what does and doesn't work for you here — it sharpens every match we show you.
Job description
About the Role
We are looking for a Lead Data Engineer with expertise in Azure and Databricks to define the technical vision and architecture for a cutting-edge enterprise data platform. This role involves directing the creation and implementation of scalable, secure, and cost-effective cloud data services vital for decision-making in the public sector. As a technical lead, you will balance hands-on engineering with strategic architectural insights, promoting best practices in cloud-native solutions across Azure, Databricks, and containerized environments. You will mentor an Agile data engineering team and collaborate closely with architects and business stakeholders to ensure the platform meets contemporary standards in data governance, analytics, and integration.
Key Responsibilities
- Lead the technical design and deployment of Azure data services, Databricks environments, and streaming data solutions.
- Advocate and implement DevOps methodologies, Infrastructure as Code using Terraform and Azure DevOps, CI/CD pipelines, and proactive system observability.
- Provide technical leadership and mentoring to elevate the data engineering team’s capabilities.
- Collaborate with architects and key stakeholders to align platform developments with organizational objectives.
- Enhance the platform’s architecture to enable secure data sharing, advanced analytics, and robust governance.
- Lead technical governance, standardization efforts, and promote cloud-first delivery approaches.
Required Skills and Experience
- Demonstrated expertise in designing and managing large-scale enterprise cloud data platforms.
- Strong proficiency with Azure Databricks, Apache Spark, Delta Lake, and Terraform for infrastructure automation.
- Deep understanding of cloud-native architecture principles, containerization technologies including AKS and Docker, and integrated security mechanisms.
- Experience with contemporary data governance tools and adherence to compliance standards.
- Proven ability to mentor technical teams and lead deliverables within Agile workflows.
- Excellent communication skills for effectively conveying cloud data platform strategies to diverse audiences.
Additional Information
- Location: Wellington, New Zealand
- Employment Type: Full-time, Fixed Term until June 2027 with a possibility of extension as part of a multi-year initiative.
- Work Eligibility: Only candidates legally authorized to work in New Zealand will be considered.
- Education: Bachelor’s degree in ICT or related field required.
- Experience: Minimum 5 years in relevant roles.
Equal Opportunity Statement
Our organization is committed to fostering diversity and equal employment opportunities. Applications from candidates of all backgrounds are encouraged.
Level
Lead
Minimum education
Bachelor's Degree