Senior Data Engineer

Responsibilities

• Design, build, and maintain scalable data pipelines, ETL/ELT workflows, and data models
• Develop and optimize AWS-native data platforms using Glue, EMR, Airflow, Lambda, and Redshift
• Build high-performance ingestion and orchestration workflows using Apache Iceberg, Parquet, and Avro
• Design analytical data platforms using Amazon Athena, Trino, and Hive
• Build AI-enabled data solutions using Amazon Bedrock, RAG pipelines, and vector search
• Develop cloud infrastructure using CloudFormation, GitHub, and CI/CD pipelines
• Lead modernization initiatives migrating legacy platforms like IBM DataStage and Hadoop to AWS
• Mentor junior engineers through technical guidance and code reviews

Requirements

• US Citizenship required (must be able to obtain Public Trust clearance)
• Bachelor's degree in Computer Science, Engineering, or a related technical field
• 9+ years of professional experience in data engineering
• Strong hands-on experience with Databricks, Apache Spark (PySpark), Python, SQL, and dbt
• Extensive experience with AWS services (Glue, EMR, MWAA, Lambda, S3, Redshift, RDS)
• Experience with modern data lake technologies like Apache Iceberg
• Proficiency in Java and CI/CD practices
• Experience working in Agile environments

Preferred Qualifications

• Experience with Kafka for streaming pipelines
• Experience with Docker and Kubernetes
• Proficiency with Splunk for monitoring
• Experience using Terraform for infrastructure automation
• Experience in highly regulated environments (financial regulators, capital markets)

Benefits

• Remote Work
• Competitive Compensation Package
• Medical, Dental, and Vision
• Life Insurance, Short/Long Term Disability
• 401(k) with 4% matching
• Liberal PTO vacation policy
• Generous Annual Continuing Education
• Annual Wellness Budget
• Bonus Incentive Programs

About the Company

Capital Technology Group (CTG) provides expert consulting services in software development, digital transformation, data analytics, and cybersecurity. We partner with federal agencies to build secure, scalable, and mission-driven solutions.