Azure Data Engineer

About the Role

The Azure Data Engineer will take charge of crafting, developing, and deploying large-scale data processing workflows on the Azure Databricks platform. This position demands partnership with data scientists, analysts, and business teams to produce dependable, scalable, and efficient analytics solutions aligned with business goals.

Core Responsibilities

• Develop and fine-tune data pipelines utilizing Azure Databricks, Apache Spark, and associated technologies.
• Create and manage ETL processes to ingest data from various sources into Azure Data Lake and other storage systems.
• Work collaboratively with diverse teams to capture data needs and deliver comprehensive solutions.
• Continuously monitor, debug, and improve Databricks workloads to ensure optimal performance, reliability, and scalability.
• Maintain high standards of data quality, ensure security measures, and comply with both corporate and regulatory policies.
• Produce documentation covering procedures, technical designs, and recommended practices for future maintenance and team knowledge sharing.

Eligibility

Any graduate is welcome to apply for this position.