Hatch

Data Engineer

Hatch

Sydney, New South Wales, Australia · Full Time

Be the first to apply

Experience
2+ yrs
Salary
Openings
1
Posted
4 days ago
Work mode
In office
Resume
Required to apply

Where you'll work

Sign in to tell us what does and doesn't work for you here — it sharpens every match we show you.

Job description

About Australian Payments Plus

We are a united team working together to combine people and technology, enhancing experiences for all. At Australian Payments Plus (AP+), we encourage you to propose bold ideas and contribute meaningfully while advancing your career and maintaining balance with fun, friendships, and flexibility.

Our core values are to lead with heart, learn for tomorrow, and live our legacy. We are committed to making an impact through collaboration and shared purpose. If you want to be part of changing the payments landscape, AP+ is eager to support your growth.

Role Overview

As a Data Engineer at AP+, your role involves converting vast payment data streams in Australia's ecosystem into reliable, accessible datasets that drive product development, analytics, and informed decisions. This is a hands-on engineering position that focuses on designing, constructing, and deploying secure, scalable data pipelines on a modern platform using technologies such as Snowflake, AWS, Python, SQL, APIs, and real-time data processing.

Key Responsibilities

  • Create, deploy, and maintain scalable batch and streaming data pipelines to collect, transform, and make large complex datasets usable for business needs.
  • Develop ingestion pipelines to integrate data from diverse sources including APIs, databases, file systems, event streams, and external platforms.
  • Design pipelines ensuring reliability, scalability, optimal performance, and ease of maintenance.
  • Implement orchestration, monitoring, error handling, reconciliation, and recovery features.
  • Incorporate incremental processing, change data capture, and event-driven integration patterns where applicable.
  • Apply rigorous governance and security practices to sensitive payment and transaction datasets.
  • Develop Snowflake data artifacts such as tables, views, schemas, and stored procedures.
  • Create tests to verify data quality and transformation accuracy.
  • Monitor and optimize pipeline and platform metrics; troubleshoot technical challenges effectively.
  • Participate in on-call support duties within a rotational schedule.

Required Qualifications and Experience

  • Minimum of 2 years experience managing enterprise-grade or banking-level data infrastructure, especially in payments, banking, or financial services sectors.
  • Proficiency with cloud-based databases such as Snowflake and DBT; workflow orchestration tools like Airflow; and event streaming platforms such as Kafka.
  • Experience developing and maintaining software components integral to build pipelines.
  • Strong command of Snowflake, SQL, and NoSQL data stores, capable of handling complex queries, transformations, and large-scale data management.
  • Advanced Python skills for building data integrations and pipelines utilizing APIs, ETL frameworks, and cloud platforms like AWS.
  • Robust understanding of data modeling, data quality assurance, reconciliation techniques, governance protocols, and security measures for transaction and payment data.
  • Experience in linking and operationalizing data across warehouses, data lakes, streaming systems, and analytics tools with focus on performance, scalability, and reliability.
  • Collaborative and curious engineering mentality comfortable working autonomously within Agile teams and partnering with analysts and stakeholders to deliver actionable data insights.

Additional Information

At AP+, we embrace passion, pride, and purpose to collectively advance the payments industry. If you are passionate about resolving complex data challenges and working with Australia’s payment data ecosystem, we encourage you to apply. The recruitment team aims to respond within two weeks.

We promote inclusiveness and support applicants needing assistance with their applications. Please reach out to the recruitment team if such support is required. Applicants are welcome to share their pronouns during the hiring process.

Note: AP+ is working directly for this opening and is not collaborating with recruitment agencies. Candidates are encouraged to apply even if they don’t meet every requirement.

Tools & software

Apache Kafka required Apache Airflow required Amazon Web Services AWS required Snowflake required

How they work

Teamwork & Collaboration Problem Solving Independence Learning Agility

Leave it if you'd like a reply — we won't use it for anything else.

Click to browse, drag & drop, or paste a screenshot

PNG, JPG, GIF, MP4, WebM, MOV · Max 20MB each · Up to 5 files

🤖
Online · instant AI help
Broxer