Whiteshield

Senior Data Engineer - AI-Accelerated Data Architecture & Platforms

Whiteshield

Posted 2 months ago

Employment Type

Full Time

Location

Dubai

Job Listing No Longer Available

This job posting is no longer accepting applications. It may be more than 30 days old or the position has been filled.

Requirements

BSc/MSc, 6+ years, Azure expertise, Python skills, SQL expertise, Airflow experience, Azure Data Factory, SSIS knowledge, SSAS experience, Azure Synapse, PostgreSQL skills, MSSQL skills, Data modeling, ETL/ELT frameworks, CI/CD pipelines, Data governance, AI integration

Required Skills

Azure Azure Fabric Azure Synapse Airflow Azure Data Factory SSIS SSAS PostgreSQL MSSQL Python PySpark Pandas SQL DBT Power BI Data Modeling ETL/ELT CI/CD Data governance Machine Learning GitOps

Job Description

Responsibilities

  • Define and maintain the enterprise data architecture blueprint across ingestion, data lake, warehouse, and semantic layers.
  • Collaborate with application and platform teams to align application design, API contracts, and long-term data scalability.
  • Develop integration patterns and governance models supporting interoperability, data lineage, and secure data sharing.
  • Partner with cloud architects to ensure performance, scalability, cost-effectiveness, and compliance across Azure environments.
  • Build and optimize end-to-end data pipelines using Apache Airflow, Azure Fabric, Azure Data Factory, and SSIS for transactional, streaming, and analytical sources.
  • Implement AI-accelerated data processing for intelligent schema mapping, deduplication, and performance tuning.
  • Develop and maintain ETL/ELT frameworks using SQL and Python (Pandas, PySpark) for high-volume, low-latency data movement.
  • Design semantic data models, dimensional schemas, and data marts using SSAS, PostgreSQL, MSSQL, and Azure Synapse/Fabric.
  • Collaborate with BI and analytics teams to support dashboards, reports, and forecasting tools with documented, contextualized data models.
  • Define and implement standards for data quality, lineage, observability, and access control; implement automated validation and monitoring.
  • Work with governance and security teams to ensure compliance with national and organizational data frameworks.
  • Mentor junior data engineers and champion best practices in modern data engineering and DevOps for data.

Requirements

  • BSc/MSc
  • 6+ years
  • Azure expertise
  • Python skills
  • SQL expertise
  • Airflow experience
  • Azure Data Factory
  • SSIS knowledge
  • SSAS experience
  • Azure Synapse
  • PostgreSQL skills
  • MSSQL skills
  • Data modeling
  • ETL/ELT frameworks
  • CI/CD pipelines
  • Data governance
  • AI integration

Preferred Qualifications

  • Experience with Google Cloud or multi-cloud architectures
  • Prior government-scale or public-sector projects
  • Certifications: Azure Data Engineer / Solutions Architect
  • Experience with dbt and Power BI semantic models
  • Strong leadership and mentoring experience
  • Familiarity with GitOps and infrastructure-as-code

Benefits

  • Annual leave and paid time off
  • Health insurance coverage
  • Gratuity as per UAE regulations
  • Flexible/hybrid working model supporting work-life balance
  • Career development and progression opportunities
  • Inclusive equal-opportunity culture and wellbeing support

About the Company

Whiteshield is a global policy advisory and AI economics firm that combines advanced tools, technology, and international expertise to support decision-makers tackling major societal challenges. Whiteshield X is our product arm delivering PaaS and SaaS solutions—partnered with Google Cloud—to improve citizen and business outcomes in employment, trade, education, and more. We build scalable, government-grade solutions that connect policy, business, and technology to deliver measurable impact.

How to Apply

Similar Jobs You Might Be Interested In

Join Dubai's Remote Work Revolution.

Stay ahead in your career with Dubai's first platform dedicated to remote and hybrid job opportunities. Subscribe for weekly insights and job alerts directly to your inbox.

Thank you for subscribing! Check your inbox for confirmation.
Weekly Job Alerts
Subscribe to receive curated lists of the best remote and hybrid job opportunities in Dubai, tailored to your skills and interests.
Weekly Blog Newsletter
Get the latest insights, trends, and advice on remote work every week to help you thrive in the evolving work environment.