Solution Data Engineer Sr.

VALCE T@lent Solutions

Completely RemoteFull TimeInformation Technology
Posted Today

Job description

Responsibilities

  • Manage the Databricks environment, workspace administration, and configuration
  • Implement governance with Unity Catalog and manage Delta Lake storage
  • Build and optimize data processing logic with Python, SQL, and PySpark
  • Manage code lifecycle and collaboration using Git
  • Support data architecture, performance, and integrations in Snowflake
  • Handle Adobe Data Feeds and Adobe Analytics ingestion and transformation
  • Maintain and monitor pipelines across cloud platforms, including Airflow workflows
  • Support data availability and basic operations in BigQuery, Athena, and AWS Glue

Requirements

  • Advanced English
  • Strong experience with Databricks ecosystem administration
  • Experience with Unity Catalog and Delta Lake
  • Proficiency in Python, SQL, and PySpark
  • Git-based collaborative development
  • Snowflake data warehousing experience
  • Adobe Analytics and data feed ingestion experience
  • Airflow orchestration experience
  • Familiarity with BigQuery, Athena, and AWS Glue

Skills & tools

DatabricksPythonPySparkSnowflakeAirflowBigQueryAWS

What the team is looking for

Use this list as a quick fit check before you apply.

  1. 01Advanced English
  2. 02Databricks
  3. 03Unity Catalog
  4. 04Delta Lake
  5. 05Python
  6. 06SQL
  7. 07PySpark
  8. 08Git
  9. 09Snowflake
  10. 10Adobe Analytics
  11. 11Airflow
  12. 12BigQuery
ScoutJobsAd

Wake up to a shortlist, not a search results page.

ScoutJobs scores every new listing against your CV, salary floor and visa. A handful of real matches by morning.

Get your daily matches