- Experience
- Any
- Salary
- —
- Openings
- 1
- Posted
- 6 hours ago
- Work mode
- In office
- Eligibility
- Open to candidates without a graduation degree requirement.
- Resume
- Required to apply
Where you'll work
Sign in to tell us what does and doesn't work for you here — it sharpens every match we show you.
Job description
Overview
We are seeking a skilled Data Engineer with strong expertise in Python programming and experience working with Snowflake databases. The role involves designing and optimizing data solutions, including data lakes and orchestration frameworks.
Key Responsibilities
- Develop and manage data pipelines using Apache PySpark and SQL, including complex queries with joins, window functions, subqueries, partitions, and indexes.
- Implement and maintain data lake architecture, specifically utilizing the medallion architecture.
- Orchestrate workflows using Apache Airflow to ensure smooth data operations.
- Optimize performance of Spark, PySpark, and Hive applications for efficient processing.
Additional Skills (Preferred)
- Familiarity with Trino or AWS Athena for querying data.
- Knowledge of data quality management practices.
- Experience with file storage solutions such as AWS S3.
Location
Positions available in Chennai, Bangalore, and Mumbai.
Industry
IT Services & ConsultingSkills
Tools & software
Apache Airflow
required