Lead Data Engineer

Recruin

Completely RemoteContractInformation Technology
Posted 1 months ago

Job description

Responsibilities

  • Design, build, and maintain scalable data pipelines using Microsoft Fabric (Data Factory, Lakehouse, Warehouse).
  • Implement Medallion Architecture (Bronze, Silver, Gold layers) to ensure data quality, governance, and analytics readiness.
  • Ingest structured and semi-structured data from multiple sources using Fabric Data Factory pipelines.
  • Perform data transformation, cleansing, and enrichment using Spark (PySpark) and SQL.
  • Support data analysis and business intelligence by preparing datasets for Power BI dashboards and reports.
  • Optimize performance and cost through partitioning, indexing, and query tuning.
  • Collaborate with data analysts, data scientists, and business stakeholders to translate requirements into data solutions.
  • Monitor pipeline execution, troubleshoot failures, and implement error-handling mechanisms.
  • Stay current with Microsoft Fabric updates and best practices to continuously improve data solutions.

Requirements

  • Microsoft Fabric
  • Data Pipeline
  • Medallion Architecture
  • Data Transformation
  • Power BI
  • Performance Optimization
  • Collaboration
  • Monitoring
  • Continuous Improvement

Preferred Qualifications

  • [Not specified in the job description]

Benefits

  • [Not specified in the job description]

About the Company

Contract Resources, IT Contractor, Staffing, Hiring, Recruitment, Hire, Temp Resource, Gig Workers, Gig Economy, Sharing Economy, Digital Nomads, Bench Resources, Bench Employees, Flexistaffing, Contract Hiring, Contract Workers, Part-Time Resources, Flexible Hiring, Flexi Staffing, Flexible Staffing, remote working jobs, workforce as a service, hire a freelancer online, Quick Talent Marketplace, Talent Marketplace, Business Community, Network Community, IT Companies, Software Companies, Bench Sharing, Sell Bench, Bench Sales, Vetted Resources, We are hiring, Find Clients, Lead Generation, Outsourcing, Offshore Development, Remote Developers, Remote workers, Part-Time Jobs, Contract Jobs, Contractors, Contract Staffing, Staff Augmentation, Staffing, Staffing Agency, Placement Agency, Manpower Agency, Hiring Company, Architect, CTO, SMEs, Quick Hiring, Marketplace, Gig Platform, Sharing Economy, On-demand Hiring, C2C, Corp 2 Corp, and Bench Recruiter

Skills & tools

Microsoft FabricData FactoryLakehouseWarehouseMedallion ArchitectureSparkPySparkSQLPower BI

What the team is looking for

Use this list as a quick fit check before you apply.

  1. 01Microsoft Fabric
  2. 02Data Pipeline
  3. 03Medallion Architecture
  4. 04Data Transformation
  5. 05Power BI
  6. 06Performance Optimization
  7. 07Collaboration
  8. 08Monitoring
  9. 09Continuous Improvement