Senior Data Engineer

Recruiter
We Are Aspire Ltd
Location
London (Greater)
Salary
£60k - £70k pa + 10% bonus + benefits
Posted
01 Nov 2017
Closes
16 Nov 2017
Sector
Engineering
Contract Type
Permanent
Hours
Full Time

Senior Data Engineer

London / Surrey

£60,000 - £70,000 + 10% bonus + benefits

A fantastic opportunity has arisen working for a multinational organisation as a Senior Data Engineer. They have over 100 offices worldwide and multiple divisions making them a leader in the field of analysis, research and insight.

For this role, you would be sat within one of their divisions that focus on the retail sector. As a division, they provide trends, forecasting and insights for retail clients.

Currently the team is made up of software developers, data scientists and data engineers. They are looking for a Senior Data Engineer who can help them deal with big unstructured data so that they can start adding in more data variables to their models.

Role of Senior Data Engineer

- Help them build up their forecasting and big data R&D platforms
- Build out the products and services that they run on these platforms
- Using your knowledge and passion for open source and cloud based platforms to enhance the methods and products delivered by the division
- Support the data scientist team with ingestion, data wrangling and preparation of new data sets
- Design and develop new projects and integrations with existing systems
- Research and adopt new technologies
- Set up and configure Hadoop clustered environment
- Process large data sets in a distributed manner using Spark

Requirements of Senior Data Engineer

o Experience coding with any of these: ASP .Net C#, Java, Python and R
o Experience dealing with cloud based technologies
o Experience dealing with large, unstructured data
o SQL
o Knowledge of BI tools like Tableau, Power BI
o Ability to set up and Configure an Hadoop Clustered environment - using Cloudera distribution (or similar, i.e. Hortonworks or MapR)
o Knowledge of data streaming technologies - preferably Apache Kafka (with Confluent Open Source) would be beneficial


This job was originally posted as www.jobsite.co.uk/job/959444476