Data Engineer

ClearPeaks · Abu Dhabi

Hybrid: Abu DhabiFull TimeEngineering & Architecture
Posted Today

Job description

Responsibilities

  • Develop, deploy, and manage data pipelines following CI/CD practices
  • Orchestrate data pipelines using tools such as Airflow, Oozie, or Azure Data Factory
  • Develop Python scripts or Scala code for efficient data processing
  • Collect and analyze pipeline requirements to ensure business alignment
  • Consult on architectural and design principles for robust pipeline development
  • Securely transfer data between different network domains and environments
  • Improve the performance and enhance the structure of data models and pipelines

Requirements

  • Degree in Statistics, Computer Science, Telecommunication Engineering, Informatics, or a related field
  • Proven experience working with Python or Scala
  • Experience with orchestration tools like Airflow or Oozie
  • Proficiency with CI/CD and DevOps tools such as Git, AWS CI/CD Pipelines, or Azure DevOps
  • Strong knowledge of SQL
  • Expertise in solutioning within cloud data platforms, specifically Databricks
  • Ability to handle data ingestion, cleansing, ETL, and data mart creation

Benefits

  • Hybrid working model with options for office-based or remote work in Spain
  • Structured mentoring, training, and certification programs for continuous growth
  • Flexible benefits plan including health insurance, transport, and childcare vouchers
  • Competitive remuneration aligned with market benchmarks
  • 23 vacation days plus December 24th and 31st
  • Collaborative company culture with regular team events and community initiatives

About the Company

ClearPeaks is a specialist consulting firm delivering services in "Everything Data," including Business Intelligence, Advanced Analytics, Big Data, and Cloud solutions. As part of a strategic alliance with Synvert, we aim to become one of EMEA’s largest Data & Analytics consulting companies, helping clients gain valuable insights through market-leading enterprise technology.

Skills & tools

PythonScalaAirflowDatabricksSQLAWSAzure

What the team is looking for

Use this list as a quick fit check before you apply.

  1. 01Degree in Statistics, Computer Science, or related field
  2. 02Proven experience with Python or Scala
  3. 03Experience with orchestration tools like Airflow or Oozie
  4. 04Proficiency with CI/CD & DevOps tools (Git, AWS, Azure DevOps)
  5. 05Knowledge of SQL
  6. 06Expertise in Databricks cloud data platforms