Data Assurance Lead

Responsibilities

• Design and operationalize a Data Assurance Framework across Lakehouse (Bronze, Silver, Gold)
• Implement Soda Core checks, data quality rules, SLAs, and reconciliation across pipelines
• Automate data contracts, validations, and regression test suites; integrate scorecards in OpenMetadata
• Configure alerts and thresholds, manage incidents, define escalation and runbooks
• QA and governance for AWS Glue jobs; embed best practices with Data Factory squads
• Analyze data issues, implement countermeasures, optimize check performance, and train teams

Requirements

• 8+ years in data engineering or data quality; 3+ years in data assurance leadership
• Strong experience with Soda Core or similar data quality frameworks
• Lakehouse and Medallion architecture expertise
• Proficiency with AWS S3, Glue, Athena, and data validation techniques
• Experience with data contracts, metadata, and lineage tools (OpenMetadata preferred)
• Proven automation mindset, building validation and reconciliation pipelines
• Excellent communication, stakeholder management, and Agile delivery (Jira)

Preferred Qualifications

• Financial Services or Banking sector experience
• Hands-on with AWS Glue and Azure Data Factory workflows
• Experience defining freshness and timeliness SLAs
• Building data quality scorecards and automated regression tests
• Incident management processes and cross-functional leadership
• Documentation, training, and enablement across squads

Benefits

• Competitive salary and performance bonuses
• Comprehensive health insurance
• Professional development and certification support
• Flexible working arrangements
• Opportunity to work on cutting-edge AI projects
• Career advancement in a rapidly growing AI company

About the Company

DeepLight AI is a specialist AI and data consultancy with expertise in data science, statistical modeling, AI/ML, workflow automation, and systems integration. We partner with enterprises—particularly in financial services and banking—to implement intelligent, reliable data platforms. Our culture values technical mastery, clear communication, and measurable business outcomes, with a strong focus on data reliability and quality.