Azure Databricks Pyspark Developer
Noida, Uttar Pradesh, India · Full Time
Be the first to apply
- Experience
- 5–14 yrs
- Salary
- —
- Openings
- 1
- Posted
- 11 ore fa
- Work mode
- In office
- Education
- Any graduate
- Eligibility
- Candidates holding a minimum of 15 years of full-time education, such as graduates, are eligible to apply.
- Resume
- Required to apply
Where you'll work
Sign in to tell us what does and doesn't work for you here — it sharpens every match we show you.
Job description
Company Overview
Tata Consultancy Services (TCS) is a leading global IT services, consulting, and business solutions provider, partnering with major global enterprises for over five decades. The organization fosters innovation and collective expertise to drive impactful technological transformation.
Role Summary
TCS is recruiting experienced professionals for the position of Azure Databricks Pyspark Developer. This role demands comprehensive experience with Azure ecosystems and big data technologies to develop robust ELT pipelines and manage data lake architectures.
Key Responsibilities and Skills
- Design and implement Data Lake architectures using Azure services such as Azure Data Lake Storage (ADLS), Azure Data Factory (ADF), Azure Databricks, Azure Synapse, and SQL.
- Develop ELT pipelines leveraging Azure Data Factory, Databricks Autoloader, Notebook scripting, and Synapse Activity Copy and Data Flow tasks.
- Utilize expertise in Databricks Delta lakehouse concepts, including Delta live tables (DLT) for efficient data processing.
- Implement metadata-driven and dynamic data pipelines; manage metadata effectively.
- Employ data transformation techniques using Spark and SQL technologies within cloud environments.
- Follow best practices and design patterns tailored to cloud infrastructure.
- Utilize version control systems such as Git for code management.
- Resolve complex issues related to ETL workflows and data pipelines through strong debugging and problem-solving skills.
- Understand internals and advanced capabilities of Azure Databricks and Azure Synapse.
- Apply knowledge of Azure DevOps tools and CI/CD pipelines for streamlined deployment.
- Practice data quality assurance with profiling, validation, and cleansing methods.
Eligibility and Qualifications
Applicants should have completed at least 15 years of full-time education (equivalent to a graduate degree).
Work Locations
The position is based in Noida, Hyderabad, Chennai, Mumbai, Bengaluru, or Kolkata, India.
Additional Information
This role targets candidates with 5 to 14 years of relevant industry experience. Applicants are encouraged to consider TCS's careers portal for further opportunities.
Minimum education
Bachelor's Degree