Senior Data Engineer

Responsibilities

• Design, develop, and maintain scalable, production-ready data pipelines and data products using Spark (Python/SQL) in a Databricks environment
• Lead the integration and transformation of complex data from diverse DoW and federal health systems
• Design scalable approaches for data ingestion, integration, and exchange, including API-based integrations
• Establish and promote reusable data engineering patterns, standards, and best practices
• Provide technical guidance on data architecture, pipeline design, data modeling, and engineering practices
• Monitor, troubleshoot, and optimize production workflows and data pipelines
• Define and implement data validation, quality, and governance practices
• Collaborate with engineers, architects, analysts, and customer stakeholders to translate complex data needs into technical solutions
• Provide technical guidance and mentorship to other engineers

Requirements

• 10+ years of data engineering or software engineering experience
• Advanced proficiency with Python and SQL
• Strong experience with Apache Spark and distributed data processing
• Experience working with Databricks or similar modern data platforms
• Experience designing and maintaining ETL/ELT processes for large-scale datasets
• Experience integrating data across disparate systems via API-based integrations
• Strong understanding of data modeling, architecture, quality, and governance principles
• Experience with Git-based development workflows and terminal/command-line environments
• U.S. Citizenship required with an active DoD Secret clearance or higher

Preferred Qualifications

• AWS cloud experience
• Experience with Palantir Foundry or GitLab
• Experience working with Advana or similar DoD data environments
• Experience working with federal health or regulated sensitive data
• Experience using AI/ML to accelerate development tasks

Benefits

• Flexible PTO plus all Federal holidays off
• Health, dental, and vision insurance plans
• 401k with employer match
• Professional development opportunities including training and certifications
• Company social events and access to sports tickets