Lead Data Engineer

Alpheya · Abu Dhabi

Hybrid: Abu DhabiFull TimeInformation Technology
Posted 3 months ago

Job description

Responsibilities

  • Lead a team of 2–3 Data Engineers to deliver production-ready ETL pipelines and backend services.
  • Design, implement and maintain high-throughput batch and streaming ETL workflows ingesting market data.
  • Develop async orchestration and scheduling to meet SLAs and surface operational metrics.
  • Build secure, versioned REST APIs (FastAPI) exposing market data and configuration entities.
  • Implement observability: structured logs, traces, metrics, alerts and dashboards (Prometheus/Grafana, OpenTelemetry).
  • Maintain code quality, type-safety, tests, and CI/CD workflows; participate in code reviews.
  • Collaborate with data scientists and product managers to translate requirements into backend capabilities.

Requirements

  • Master's degree
  • 5+ years
  • Python 3.10+
  • Asyncio & typing
  • ETL pipelines
  • Kafka or RabbitMQ
  • Postgres expertise
  • Airflow or Dagster
  • FastAPI experience
  • DevOps familiarity
  • Pytest experience
  • Kubernetes knowledge
  • CI/CD pipelines
  • Communication skills

Preferred Qualifications

  • TimescaleDB, ClickHouse, or InfluxDB experience
  • Financial market-data protocols knowledge (e.g., FIX/FAST)
  • Experience with RAG/Agent integrations

About the Company

Alpheya is a B2B WealthTech startup headquartered in Abu Dhabi and backed by BNY Mellon and Lunate. The company has raised significant capital to build a modern digital wealth management platform focused on serving banks and financial institutions across the Middle East, targeting affluent, HNW and UHNW investor segments. Alpheya operates with cross-functional, agile teams to deliver production-grade financial technology solutions.

Skills & tools

PythonFastAPIPostgresKafkaRabbitMQAirflowDagsterCeleryPrometheusGrafanaOpenTelemetryDockerKubernetesTerraformPytestGitHub ActionsTimescaleDBClickhouseInfluxDBasyncioTypingAlembicRAGAgentsRESTCI/CDObservability

What the team is looking for

Use this list as a quick fit check before you apply.

  1. 01Master's degree
  2. 025+ years
  3. 03Python 3.10+
  4. 04Asyncio & typing
  5. 05ETL pipelines
  6. 06Kafka or RabbitMQ
  7. 07Postgres expertise
  8. 08Airflow or Dagster
  9. 09FastAPI experience
  10. 10DevOps familiarity
  11. 11Pytest experience
  12. 12Kubernetes knowledge
  13. 13CI/CD pipelines
  14. 14Communication skills