Senior Data Engineer

Responsibilities

• Design, develop, and maintain data retrieval processes from APIs, SFTP, HTTPS, FTP, and web scraping
• Build and maintain ingestion pipelines using AWS Glue (PySpark), MWAA, EMR, Lambda, and Step Functions
• Process large-volume XML filings into Apache Iceberg tables
• Implement technical data quality standards and custom Glue data quality checks using Deequ
• Develop and maintain the semantic layer using Trino and Athena
• Deploy ETL resources using CloudFormation and CI/CD pipelines
• Create full documentation suites including data models, dictionaries, and mapping documents
• Participate in agile ceremonies including PI planning and 2-week sprints

Requirements

• Bachelor's degree in Computer Science, Information Systems, Data Engineering, or a related field
• 6+ years of hands-on data engineering experience
• Expertise in AWS Glue, PySpark, and Python (PEP 8)
• Experience building large-scale ETL pipelines on AWS (S3, MWAA, EMR, Lambda, SNS, SQS, EventBridge)
• Experience with Apache Iceberg, Parquet, ORC, and Avro
• Proficiency with PostgreSQL, Redshift, and Oracle
• Experience with Trino, Athena, and Hive
• Proficiency with CloudFormation (IaC) and GitHub workflows
• US Citizenship required
• Ability to work 8am-5pm Eastern Time
• Ability to obtain a federal public trust suitability determination

About the Company

Simple Technology Solutions (STS) provides exceptional solutions to Federal Government clients. Recognized as a "Best Place to Work," STS fosters a culture of collaboration, continuous learning, and excellence while supporting critical government functions.