Senior Data Engineer

About the Company

Capital Technology Group (CTG) provides expert consulting services in software development, digital transformation, human-centered design, data analytics, and cybersecurity. They are dedicated to modernizing how the federal government delivers software through agile methodologies and multidisciplinary teams.

Responsibilities

• Design, build, and maintain scalable, efficient data pipelines and systems
• Evaluate and prototype new tools and technologies, assessing risks and benefits
• Build and maintain scalable data pipelines and models using Databricks, dbt, and SQL
• Develop robust data solutions leveraging AWS services including Redshift, RDS, S3, Glue, Lambda, DMS, and CloudWatch
• Implement data transformations and integrations using Python and Java
• Implement infrastructure-as-code using Terraform
• Monitor and optimize system health using CloudWatch and Splunk
• Mentor junior engineers and conduct code reviews
• Collaborate with cross-functional stakeholders in agile environments

Requirements

• Bachelor's degree in Computer Science, Engineering, or a related technical field
• 7+ years of professional experience in data engineering
• Deep expertise in Databricks
• Strong experience with AWS native services
• Proficiency in dbt, SQL (PostgreSQL), Python, and Java
• Proven leadership experience in technical teams
• Must be a US Citizen and able to obtain Public Trust clearance

Preferred Qualifications

• Experience with Kafka for streaming and data pipelines
• Experience with Docker and Kubernetes
• Proficiency with Splunk for log aggregation
• Experience using Terraform for infrastructure automation
• Advanced SQL skills including performance tuning