Senior Data Engineer - AI-Accelerated Data Architecture & Platforms

Responsibilities

• Define and maintain the enterprise data architecture blueprint across ingestion, data lake, warehouse, and semantic layers.
• Collaborate with application and platform teams to align application design, API contracts, and long-term data scalability.
• Develop integration patterns and governance models supporting interoperability, data lineage, and secure data sharing.
• Partner with cloud architects to ensure performance, scalability, cost-effectiveness, and compliance across Azure environments.
• Build and optimize end-to-end data pipelines using Apache Airflow, Azure Fabric, Azure Data Factory, and SSIS for transactional, streaming, and analytical sources.
• Implement AI-accelerated data processing for intelligent schema mapping, deduplication, and performance tuning.
• Develop and maintain ETL/ELT frameworks using SQL and Python (Pandas, PySpark) for high-volume, low-latency data movement.
• Design semantic data models, dimensional schemas, and data marts using SSAS, PostgreSQL, MSSQL, and Azure Synapse/Fabric.
• Collaborate with BI and analytics teams to support dashboards, reports, and forecasting tools with documented, contextualized data models.
• Define and implement standards for data quality, lineage, observability, and access control; implement automated validation and monitoring.
• Work with governance and security teams to ensure compliance with national and organizational data frameworks.
• Mentor junior data engineers and champion best practices in modern data engineering and DevOps for data.

Requirements

• BSc/MSc
• 6+ years
• Azure expertise
• Python skills
• SQL expertise
• Airflow experience
• Azure Data Factory
• SSIS knowledge
• SSAS experience
• Azure Synapse
• PostgreSQL skills
• MSSQL skills
• Data modeling
• ETL/ELT frameworks
• CI/CD pipelines
• Data governance
• AI integration

Preferred Qualifications

• Experience with Google Cloud or multi-cloud architectures
• Prior government-scale or public-sector projects
• Certifications: Azure Data Engineer / Solutions Architect
• Experience with dbt and Power BI semantic models
• Strong leadership and mentoring experience
• Familiarity with GitOps and infrastructure-as-code

Benefits

• Annual leave and paid time off
• Health insurance coverage
• Gratuity as per UAE regulations
• Flexible/hybrid working model supporting work-life balance
• Career development and progression opportunities
• Inclusive equal-opportunity culture and wellbeing support

About the Company

Whiteshield is a global policy advisory and AI economics firm that combines advanced tools, technology, and international expertise to support decision-makers tackling major societal challenges. Whiteshield X is our product arm delivering PaaS and SaaS solutions—partnered with Google Cloud—to improve citizen and business outcomes in employment, trade, education, and more. We build scalable, government-grade solutions that connect policy, business, and technology to deliver measurable impact.