Data Engineer

Overview

UnfilterStory in Pune is seeking a seasoned Data Engineer with 4 to 8 years of experience specializing in big data technologies, data pipelines, distributed processing, and data modeling. Excellent communication capabilities are essential for successful collaboration with stakeholders.

Core Responsibilities and Requirements

• Design, develop, and maintain robust data ingestion and ETL/ELT pipelines ensuring quality data transformation and cleansing.
• Implement and optimize data workflows using Apache Airflow and manage streaming data with Apache Kafka.
• Write efficient code primarily in Python (with PySpark), SQL, and Java to handle large-scale data processing tasks.
• Apply deep knowledge of data modeling, including both logical and physical design, along with schema creation to support data warehouse architectures.
• Operate confidently in Linux/Unix environments, leveraging shell scripting for automation tasks.
• Collaborate with teams to ensure data quality validation processes are robust and reliable.
• Communicate effectively across stakeholders to align on data engineering solutions and project deliverables.

Desirable Skills

• Experience with RESTful API development or consumption for data integration purposes.
• Working knowledge of real-time stream processing frameworks such as Apache Flink.

Additional Details

The role is based full-time onsite in Pune. The position demands strong technical proficiency aligned with data engineering best practices and excellent stakeholder communication.

Benefits & Perks
[Details regarding benefits and perks are not specified.]