- Experience
- Any
- Salary
- —
- Openings
- 1
- Posted
- 2 小时前
- Work mode
- In office
- Resume
- Required to apply
Where you'll work
Sign in to tell us what does and doesn't work for you here — it sharpens every match we show you.
Job description
Role Overview
As a Data Engineer, you will collaborate with Quantexa architects in technical workshops and play a key role in supporting strategies around Spark execution frameworks. Your responsibilities include developing ETL pipelines, assisting with data ingestion, and preparing datasets for demonstrations. You will also aid in integrating Spark data processing workflows with Elasticsearch or OpenSearch systems.
Primary Responsibilities
- Engage actively in technical sessions with Quantexa architecture teams.
- Provide support on optimal Spark execution methodologies.
- Develop and maintain ETL processes, ensuring efficient data ingestion and transformation.
- Assist in loading and organizing datasets essential for demos.
- Facilitate integration processes between Apache Spark and search platforms such as Elasticsearch or OpenSearch.
Required Qualifications and Experience
- Proven expertise working with Apache Spark.
- Solid background in ETL development, data integration, transformation, and modelling.
- Familiarity with Elasticsearch or OpenSearch is advantageous.
- Competency in Python and/or Scala programming languages is preferred.
Tools & software
Apache Spark
required
Elasticsearch
required
OpenSearch
required