PySpark Developer

Role Overview

Zettamine Labs is seeking an experienced PySpark Developer with over 6 years of expertise to join their team in Pune or Chennai, offering a hybrid working model. The candidate must be adept in designing, developing, and optimizing big data applications, utilizing Apache Spark and Python for efficient large-scale data processing.

Key Responsibilities

• Create and support scalable data processing workflows using PySpark technology.
• Enhance and fine-tune PySpark scripts to ensure high performance and resource efficiency.
• Collaborate closely with data engineering and analytics teams to gather and understand data needs.
• Maintain data accuracy and consistency throughout all stages of the data pipeline.
• Diagnose and solve issues related to data processing operations.
• Oversee deployment and management of big data environments within distributed systems.
• Engage in peer code evaluations, offering insightful feedback for improvement.

Eligibility

Applicants must have completed at least an undergraduate degree.

Additional Information

• Work Location: Pune, India, or Chennai with hybrid work options.
• Experience: Minimum 6 years of relevant development experience.
• Notice Period: Immediate availability preferred.