Data Engineer

Responsibilities

• Design, build, and maintain scalable data pipelines, ETL/ELT workflows, and data models using Python, Apache Spark, Databricks, dbt, and SQL
• Develop and optimize AWS-native data platforms leveraging Glue, EMR, Airflow, Lambda, and Redshift
• Build high-performance ingestion and orchestration workflows using Apache Iceberg, Parquet, and Avro
• Design analytical data platforms using Amazon Athena, Trino, and Hive
• Build AI-enabled data solutions using Amazon Bedrock, RAG pipelines, and vector search technologies
• Develop cloud infrastructure using CloudFormation (IaC), GitHub, and CI/CD pipelines
• Support mission-critical analytics within AWS-based federal data environments complying with FedRAMP and NIST 800-53
• Lead modernization initiatives migrating legacy platforms like IBM DataStage and Hadoop to cloud-native AWS services
• Mentor junior engineers through technical guidance and code reviews

Requirements

• US Citizenship required (must be able to obtain Public Trust clearance)
• Bachelor's degree in Computer Science, Engineering, or a related technical field
• 4+ years of professional experience in data engineering
• Hands-on experience with Databricks, PySpark, Python, SQL, and dbt
• Proficiency with AWS services including Glue, EMR, MWAA, Lambda, S3, and Redshift
• Experience with modern data lake technologies like Apache Iceberg and Parquet
• Experience with relational and NoSQL databases (PostgreSQL, Oracle, GraphDB)
• Experience working in Agile, iterative software development environments

Preferred Qualifications

• Experience with Kafka for streaming pipelines
• Experience with Docker and Kubernetes
• Proficiency with Splunk for monitoring
• Experience using Terraform for infrastructure automation
• Experience in highly regulated environments like financial regulators or capital markets

Benefits

• Remote Work
• Medical, Dental, and Vision
• 401(k) with 4% matching
• Liberal PTO vacation policy
• Generous Annual Continuing Education
• Annual Wellness Budget
• Bonus Incentive Programs