Senior Data Engineer

About the Company

AIA Contract Documents (ACD) has supported architecture, engineering, and construction professionals for over a century by delivering shared industry standards. ACD provides a comprehensive suite of contract tools and workflows designed to help firms navigate construction complexity and reduce disputes.

Responsibilities

• Design and implement scalable data models optimized for AI/ML use cases
• Architect and manage data pipelines using Databricks, including orchestration and job scheduling
• Develop and maintain robust ETL/ELT processes for data ingestion and transformation
• Leverage Databricks Asset Bundles to manage deployment of data assets across environments
• Collaborate with cross-functional teams to align data architecture with AI initiatives
• Ensure data quality, integrity, and governance standards are met
• Contribute to CI/CD practices using Azure DevOps
• Participate in Agile development processes

Requirements

• 5+ years of experience in Data Engineering or a related field
• Strong expertise in Databricks, pipeline development, and orchestration
• Experience designing data models to support AI/ML applications
• Proficiency in Python (PySpark) and SQL
• Hands-on experience with Azure-based data environments
• Experience with CI/CD tools such as Azure DevOps (ADO)
• Ability to work independently with minimal oversight

Preferred Qualifications

• Experience with Databricks Asset Bundles
• Familiarity with transitioning CI/CD workflows to GitHub
• Experience working in Agile development environments
• Exposure to AI/ML workflows and data requirements for model development