This job has expired

Senior Data Engineer

Twenty Group
Closing date
26 Jun 2021

View more

Technology & New Media
Contract Type
You need to sign in or create an account to save a job.

Job Details

• Develop, test, operate and support the end-to-end batch, near real time data engineering solution

• Be able to develop quality Python/PySpark and adopt/implement software development best practices to ensure high quality standards are met

• Performs thorough code reviews of fellow developers and ensure quality code

• Use DevOps knowledge, cloud and data engineering expertise to operate, monitor and troubleshoot the pipelines / code bases

• Effectively test and adopt testing frameworks to embed and codify tests

• Take technical ownership for the implementation of the DE solution at an allocated mining site

• Clearly communicate and explain concepts to senior stakeholders and key teams during sprint reviews and other programme meetings

• Have a clear understanding of agile best practices and proactively collaborate and support the team if needed during the whole sprint cycle

• Document technical implementation details and artefacts created as part of the process


• Must have - Python, PySpark, version control (Git), performance engineering, Azure cloud analytics services (ADF, Databricks, SQLDB, Event Hub)

• Good to have Cloud - Databricks , Microsoft AzureDevOps, DevOps, Data Modelling, Test Automation
You need to sign in or create an account to save a job.

Get job alerts

Create a job alert and receive personalised job recommendations straight to your inbox.

Create alert