Databricks Data Engineer

Responsibilities

• Build end-to-end implementation of multiple ETL/ELT pipelines for efficient data transformation and ingestion
• Assess and understand ETL jobs, workflows, BI tools, and reports
• Address technical inquiries concerning customization, integration, and enterprise architecture
• Craft database and data warehouse solutions in the cloud (AWS, Azure, or GCP)
• Manipulate, process, and extract value from large, structured, and unstructured datasets
• Support an Agile software development lifecycle

Requirements

• Bachelor's degree in Computer Science or a technical field
• 4+ years of experience in data engineering and big data
• 2+ years of professional services experience interacting directly with clients
• Extensive knowledge of data warehousing and hands-on experience deploying pipelines using Databricks
• Proficiency in Python, SQL, and AWS Data Services
• Experience with big data tools such as Hadoop, Spark, or Kafka
• Experience with AWS cloud services (EC2, S3, Glue, EMR, etc.)
• Ability to hold a position of public trust with the US government

Preferred Qualifications

• Databricks Data Engineer Professional certification
• Experience with R, Scala, or Go
• Experience architecting scalable solutions across Azure and AWS

Benefits

• Comprehensive healthcare (medical, dental, vision, and disability)
• 401k program with 100% vesting from day one and employer match after 90 days
• Educational Assistance program
• Student Loan Repayment Program
• Gym Reimbursement Program
• Paid Time Off

About the Company

Horizon Industries Limited (Horizon) is a dynamic IT and Management Consulting firm based in the Washington, DC area. Founded in 1996, Horizon provides full-cycle IT Consultant and Management support in both the private and public sectors.