Kpler

Data Engineer

Kpler

Posted 2 years ago

Employment Type

Full Time

Location

Dubai

Job Listing No Longer Available

This job posting is no longer accepting applications. It may be more than 30 days old or the position has been filled.

Job Description

In a world where trades are happening faster than ever to answer our needs, where sustainability is not just an option anymore, clarity and trust in the information we trade with are a must. 

So, say hello to Kpler! We exist to facilitate sustainable and efficient trade to meet the changing needs of our world. To do so we've built a Data-as-a-Service solution that does exactly that across the lifecycle of a trade.

Our solution aggregates data from hundreds of sources including radar and satellite imagery as well as logistics, governmental, shipping databases and more. Intelligently connecting the dots across fragmented information landscapes, we bring to our clients a unique, real-time understanding of the trades happening all over the world, by giving them access to live information about the movement of cargos, the availability of vessels as well as commodity storage.

To support this endeavor, we have teams in more than 9 countries and 11 key locations (Brussels, Paris, London, Athens, Vienna, Rostock, Hyères, Dubai, Singapore, Houston and New York). With individuals of various backgrounds, diverse skills, and international experiences, being global & inclusive is in our DNA!


Data Engineers play a crucial role in creating the architecture and systems needed to collect, store, transform, and access data. They design, build and maintain large-scale processing systems, data pipelines and other infrastructure.

Involvement is expected in architecture, product line and relevant data science projects, and in the development and deployment of applications serving both the Kpler and MarineTraffic platforms and the organization’s internal clients. In this role, you will be part of our new Compliance product line, contributing to our mission of delivering a revolutionary vessel compliance and risk management solution. We aim to provide maritime industry stakeholders with unparalleled safety, regulatory compliance, and operational efficiency by harnessing advanced technologies like machine learning, and predictive analytics. Your involvement will bring transparency to sanctioned entities and dark vessel activities, while our innovative approach redefines industry standards for a safer and more sustainable maritime ecosystem.

Responsibilities

    • A Data Engineer is expected to be involved in all stages of the data lifecycle. The following is an indicative list:
    • Develop and deploy containerised applications within AWS, utilizing tools like Python, Docker, Kubernetes and Airflow
    • Design and deploy robust database structures and procedures using technologies such as PostgreSQL and Elastic, ensuring data integrity and optimal performance
    • Consume and write APIs to ingest and share data across various crews boosting collaboration and overall enablement
    • Work with Event Streaming. Use Kafka to facilitate seamless event handling and CI/CD practices to enhance deployment efficiency
    • Automate and produce internal tools that boost efficiency and productivity in data-related workflows
    • Utilize IaC tech like Terraform and CloudFormation to build and own AWS infrastructure through the principles of Infrastructure as Code
    • Implement logging, monitoring, and alerting mechanisms that guarantee the reliability and resilience of production-grade data pipelines
    • Collaborate and work with engineers, product and data science teams as part of the same crew
    • Contribute, execute and lead complex data pipelines design, brainstorming sessions, and peer reviews
    • Keep up-to-date with the latest tech in data lakes & warehousing, processing frameworks and data analytics. Research and implement new tools and technologies to improve the data infrastructure.

Accountabilities

    • A Data Engineer is fully accountable for the quality of developed pipelines and code ensuring their continuous support & maintenance thereafter. Additionally:
    • Active participation in team ceremonies and code reviews
    • Adherence to the data team's common best practices and development paradigms and contribution toward continuous improvement
    • Delivery of well-documented projects and effective communication of results
    • Strong sense of ownership and a growth mindset

Requirements

    • Required
    • STEM background
    • 2+ years of experience in a similar position
    • Strong Python skills (pandas, numpy, sqlalchemy, pyodbc, pep8 standards)
    • Good SQL & database development skills (indexing, execution plans & query efficiency and performance)
    • Expertise in versioning and Git best practices
    • Experience with logging, alerting & monitoring best practices
    • Experience with consuming and writing REST APIs
    • Knowledge of Data Engineering concepts, tools, architectures, and practices (streams, distributed computing frameworks, shell scripting, monitoring, CI/CD) as well as a good problem-solving mindset
    • Communication & collaboration skills
    • Nice to have
    • Experience with AWS services
    • Experience with Docker
    • Experience with Kafka
    • Experience with Elastic
    • Experience with Scala is a plus
What you will receive from Kpler:
You’ll get to work in a truly global work environment, with offices in 7 countries (UK, France, Belgium, Austria, US, Dubai and Singapore), we come from more than 50 countries and speak more than 20 languages
Remote work flexibility
Huge room for creativity and innovation
Continuous learning including unlimited access to an online training platform
Career development and growth opportunities
Attractive Remuneration based on a job grading system
Unlimited access to Mental Health Platform
Sponsored wellbeing activities such as free on-site/online fitness activities
If you feel you are a genuine fit for this role, which is both challenging and fun, we would like to hear from you.

Our values

• Be humble - We always place the interests of the collective before your own.
• Respect and care for others - We make every person feel comfortable in their own beliefs, decisions, and perspectives. 
• Take responsibility - We take ownership of our actions.
• Act with integrity -We are honest and transparent in all your dealings.
• Be bold - We push the boundaries in order to improve and grow.

You’ll get to work in a truly global environment, with more than 30 nationalities speaking more than 15 languages.

Our People Pledge

Don’t meet every single requirement? Research shows that women and people of color are less likely than others to apply if they feel like they don’t match 100% of the job requirements. Don’t let the confidence gap stand in your way, we’d love to hear from you! We understand that experience comes in many different forms and are dedicated to adding new perspectives to the team.

Kpler is committed to providing a fair, inclusive and diverse work-environment. We believe that different perspectives lead to better ideas, and better ideas allow us to better understand the needs and interests of our diverse, global community. We welcome people of different backgrounds, experiences, abilities and perspectives and are an equal opportunity employer.



By applying, I confirm that I have read and accept the Staff Privacy Notice
Apply for this job

How to Apply

Similar Jobs You Might Be Interested In

Join Dubai's Remote Work Revolution.

Stay ahead in your career with Dubai's first platform dedicated to remote and hybrid job opportunities. Subscribe for weekly insights and job alerts directly to your inbox.

Thank you for subscribing! Check your inbox for confirmation.
Weekly Job Alerts
Subscribe to receive curated lists of the best remote and hybrid job opportunities in Dubai, tailored to your skills and interests.
Weekly Blog Newsletter
Get the latest insights, trends, and advice on remote work every week to help you thrive in the evolving work environment.