Data Engineer - Technical Lead

Recruiter
Harnham
Location
London (Central)
Posted
12 Feb 2018
Closes
15 Mar 2018
Contract Type
Permanent
Hours
Full Time

Data Engineer - Technical Lead - Spark, Scala / Java, AWS, Kafka
West London
eCommerce

WHO'S HIRING

One of the UK's most widely recognised eCommerce Companies, known for being one of the most cutting-edge technology company in their sector.

Alongside some of the best Data Scientists in the industry, you'll help to develop a high performance & highly scalable Big Data platform to enable a variety of new analytics use cases, including sentiment/social media analytics, data streaming & geospatial analytics.

WHAT'S THE ROLE

As Technical Lead you'll be leading the development of a complex, highly scalable Cloudera platform, hosted on AWS. The project is all greenfield so you won't have to deal with any scrappy legacy code and you'll have the opportunity to design new features and introduce new tools.

The bulk of the work will be done with Spark (written in Scala), as well as number of other Cloudera tools, including Impala, Kafka and Flume to name a few - you'll help to choose the right tech depending on which brings the best technical and commercial benefits.

The plan is to build a cross-functional team of Data Scientists and Big Data Engineers so you'll likely gain exposure to advanced analytics and Machine Learning, using e.g. Spark MLlib.

Given the greenfield nature of the role, there are lots of career routes on offer to you, including Data Science, team leadership or Data Architecture.

WHO ARE THEY LOOKING FOR

  • Strong experience developing a production level Big Data platform, preferably Cloudera or Hortonworks, and experience with a number of Hadoop/Spark ecosystem tools
  • Solid Scala or Java programming skills
  • Experience with both batch and stream processing is preferable
  • Any experience with analytics/data science would be really useful but not necessary

HOW TO APPLY

Click the 'Apply' link on this page!
However, if you don't think this is the one for you, Harnham are working on a broad spectrum of roles in the busiest Big Data market ever - get in touch with Ross Whatling

KEYWORDS

Big DataEngineer, Big Data Developer, Big Data Software, Hadoop, Spark streaming, AWS, Cloudera, Kafka, Scala, London

Similar jobs

Similar jobs