Senior Data Engineer

Job Overview

We are inviting an experienced Senior Data Engineer to join a premier global payments technology company based in Dublin. The role involves designing and implementing large-scale data engineering systems that support advanced analytics and machine learning initiatives. This position includes leadership responsibilities such as guiding a team of engineers, coordinating with Data Scientists and Product teams, and promoting best practices within a contemporary Big Data technology stack.

Core Responsibilities

• Develop and maintain scalable data pipelines.
• Collaborate closely with Data Scientists and Product teams to deliver data-driven solutions.
• Provide mentorship and technical leadership to engineering teams.
• Advocate and implement best practices across the data engineering platform.

Required Qualifications

• At least 8 years of professional experience in data engineering.
• Proficiency in one or more programming languages: Python, Scala, or Java.
• Experience with Apache Spark, PySpark, and Databricks platforms.
• Familiarity with Hadoop ecosystem tools including Hive, Impala, Airflow, Oozie, NiFi, and Sqoop.
• Skilled in SQL, Linux or Unix environments, and both relational and NoSQL database systems.
• Demonstrated ability to lead technical teams and deliver complex, enterprise-grade data platforms.

Preferred Skills

• Experience with cloud services such as AWS or Azure.
• Expertise in cloud-native data engineering methods.
• Background in developing machine learning pipelines.

Additional Information

This role is ideal for a seasoned data engineering specialist who thrives in tackling challenging technical problems, leading talented teams, and building robust data infrastructure within an Agile development environment.