
Lead Data Engineer
Alpheya · Abu Dhabi
Hybrid: Abu DhabiFull TimeInformation Technology
Posted 3 months ago
Job description
Responsibilities
- Lead a team of 2-3 Data Engineers to deliver production-ready ETL pipelines and data APIs.
- Design, implement and maintain high-throughput market-data ETL workflows (batch and streaming).
- Build and maintain async orchestration, task queues and scheduling to meet SLAs and surface operational metrics.
- Implement secure, versioned REST endpoints (FastAPI) providing CRUD access to market data and configuration entities.
- Implement observability: structured logs, traces, metrics, alerts and dashboards (OpenTelemetry, Prometheus, Grafana).
- Ensure code quality through type-safe code, testing, code reviews and CI/CD best practices.
- Collaborate closely with data scientists, backend engineers and product managers to translate requirements into robust backend solutions.
Requirements
- Master's degree in Computer Science or related field (or equivalent experience).
- 5+ years building production Python backends for data-intensive applications.
- Modern Python (3.10+) with asyncio, typing and packaging best practices.
- Strong ETL experience handling high-volume market data.
- Experience with messaging/streaming systems (Kafka, RabbitMQ, etc.).
- Deep Postgres knowledge including migrations, partitioning and tuning.
- Experience with async orchestration/scheduling tools (Airflow, Dagster, Celery, etc.).
- API engineering experience (REST/GraphQL) with auth, versioning and RBAC.
- Familiarity with testing and DevOps tools: Pytest, Docker, Kubernetes, Terraform, GitHub Actions.
- Strong communication and leadership skills.
Preferred Qualifications
- Experience with time-series or columnar databases (TimescaleDB, ClickHouse, InfluxDB).
- Knowledge of financial market-data protocols (FIX, FAST) or regulatory data feeds.
- Prior experience operating systems at 99.9%+ availability and building observability pipelines.
Benefits
- Competitive compensation package.
- Health insurance.
- Annual leave.
- Hybrid work arrangement (Abu Dhabi-based).
- Professional development opportunities and a collaborative startup environment backed by major financial institutions.
About the Company
Alpheya is a B2B WealthTech startup based in Abu Dhabi backed by major financial investors. The company is building a modern wealth technology platform to help banks and financial institutions in the Middle East expand into affluent, HNW and UHNW investor segments. Alpheya combines startup agility with deep domain expertise to deliver differentiated financial experiences, solutions and insights.
Skills & tools
PythonFastAPIasyncioKafkaRabbitMQPostgresAlembicAirflowDagsterCeleryKubernetesDockerTerraformPytestOpenTelemetryPrometheusGrafanaTimescaleDBClickhouseFIXFASTGitHub Actions
What the team is looking for
Use this list as a quick fit check before you apply.
- 01Master's degree
- 025+ years experience
- 03Python 3.10+
- 04Asyncio
- 05ETL pipelines
- 06Kafka RabbitMQ
- 07Postgres
- 08Alembic migrations
- 09Airflow Dagster
- 10FastAPI
- 11Kubernetes
- 12Docker
- 13Terraform
- 14Pytest
- 15Observability
- 16Leadership

Alpheya
Abu Dhabi
Job details
- Work model
- Hybrid: Abu Dhabi
- Commitment
- Full Time
- Category
- Information Technology
- Posted
- 3 months ago