Data Engineer

ClearPeaks · Abu Dhabi

Hybrid: Abu DhabiFull TimeEngineering & Architecture
Posted Today

Job description

Responsibilities

  • Develop, deploy, and manage data pipelines following CI/CD practices
  • Orchestrate data pipelines using tools such as Airflow, Oozie, or Azure Data Factory
  • Develop Python scripts or Scala code for efficient data processing
  • Collect and analyze pipeline requirements to ensure technical alignment
  • Consult on best architectural and design principles for pipeline development
  • Securely transfer data between different network domains and environments
  • Improve the performance and enhance the structure of data models and pipelines

Requirements

  • Degree in Computer Science, Statistics, Telecommunication Engineering, or a related field
  • Proven experience with Python or Scala
  • Experience with orchestration tools like Airflow or Oozie
  • Proficiency in SQL and data solutioning (ingestion, cleansing, ETL, and data mart creation)
  • Expertise in cloud data platforms, specifically Databricks
  • Ability to use CI/CD and DevOps tools such as Git, AWS CI/CD Pipelines, or Azure DevOps

Benefits

  • Hybrid working model and international, collaborative team environment
  • Structured onboarding, mentoring, and professional certification programs
  • Flexible benefits plan including health insurance, transport, and childcare vouchers
  • Competitive remuneration aligned with market practices
  • 23 vacation days plus December 24th and 31st
  • Regular company events and community initiatives

About the Company

ClearPeaks is a specialist consulting firm delivering services in Business Intelligence, Advanced Analytics, Big Data, and Cloud solutions. As part of a strategic alliance with Synvert, we aim to be one of EMEA’s largest Data & Analytics consulting companies, helping clients gain value through market-leading enterprise technology platforms.

Skills & tools

PythonScalaAirflowDatabricksSQLAzureAWSCI/CD

What the team is looking for

Use this list as a quick fit check before you apply.

  1. 01Degree in Computer Science or related field
  2. 02Experience with Python or Scala
  3. 03Experience with Airflow or Oozie
  4. 04Knowledge of CI/CD and DevOps tools
  5. 05SQL proficiency
  6. 06Databricks expertise