Senior Data Engineer

Responsibilities

• Design and build robust data pipelines that integrate data from diverse sources to support risk evaluation and business intelligence
• Build streaming data pipelines using Kafka and AWS services to enable real-time data processing and decision-making
• Create and operate data services that make curated datasets accessible to internal teams and external partners through APIs and scheduled deliveries
• Support data science workflows by building infrastructure that enables model training, feature engineering, and production inference
• Implement data quality frameworks including validation, monitoring, and alerting
• Contribute to CI/CD pipelines and infrastructure-as-code practices
• Deliver highly reliable services and participate in an on-call rotation
• Contribute to the data warehouse by creating well-modeled datasets in Snowflake
• Collaborate with data scientists, analysts, and business stakeholders

Requirements

• Bachelor's degree or equivalent relevant experience
• 6-8 years of industry experience in data engineering or software engineering
• Strong proficiency in Python and SQL
• Experience with AWS data platforms (Glue, S3, Athena, Lambda, Step Functions)
• Familiarity with Snowflake or similar cloud data platforms
• Familiarity with streaming technologies such as Kafka or Kinesis
• Experience with workflow orchestration tools like Airflow or Step Functions
• Proficiency in infrastructure-as-code tools like Terraform
• Understanding of data modeling principles
• Experience with CI/CD tailored for machine learning systems

Preferred Qualifications

• Prior experience working within the insurance industry or a highly regulated environment
• Familiarity with ML infrastructure and productionizing models
• Experience designing and building feature stores or real-time feature serving systems
• Exposure to data governance and cataloging tools like DataHub or Atlan

Benefits

• Medical, dental, vision, and life insurance
• 401(k) Plan with company match
• One-time $2K payment for home office equipment
• Four weeks of PTO in the first year
• Twelve weeks of fully paid parental leave
• Up to $5,000 annual professional development allowance
• LinkedIn Learning and BetterUp coaching access

About the Company

Quanata is an insurance technology innovation company that engineers advanced risk prediction and prevention solutions. Wholly owned and funded by State Farm, Quanata builds AI-native insurance platforms to help clients adapt to evolving market needs.