Data Engineer

Responsibilities

• Design, develop, and maintain scalable data pipelines and ETL/ELT workflows
• Build and optimize data models, warehouses, and data lakes
• Develop batch and real-time data processing solutions using cloud platforms
• Collaborate with software engineers to integrate data services into applications
• Ensure data quality, integrity, governance, and observability
• Optimize database performance, storage, and query efficiency
• Implement automated testing, monitoring, and deployment pipelines
• Work with product teams to translate business requirements into technical solutions
• Troubleshoot production issues and improve system reliability
• Participate in Agile ceremonies and mentor junior engineers

Requirements

• 3+ years of professional experience in data pipelines and platforms
• Experience with ETL/ELT processes using Python or SQL
• Experience with relational and non-relational databases
• Experience with cloud platforms (AWS, Azure, or GCP)
• Strong SQL skills and query optimization experience
• Experience with data modeling and schema design
• Familiarity with distributed data processing frameworks like Apache Spark
• Experience using Git and CI/CD practices
• Understanding of data governance, security, and privacy
• Experience working within Agile software development teams

Preferred Qualifications

• Experience with AWS data services (Glue, Athena, Redshift, EMR, Lambda, S3)
• Experience with orchestration tools like Apache Airflow or Dagster
• Experience with streaming technologies like Kafka or Kinesis
• Experience with Infrastructure as Code (Terraform or CloudFormation)
• Experience supporting federal government programs
• Active Public Trust or ability to obtain one

About the Company

Pluribus Digital is a digital services consultancy that partners with government customers to design, develop, and deliver impactful digital products for public health, financial regulation, and other mission-critical programs.