Data Developer - Associate

Recruiter
Morson International
Location
London (Greater)
Posted
09 Apr 2018
Closes
20 Apr 2018
Contract Type
Permanent
Hours
Full Time
Hadoop, Big Data, Apache, Spark, Scala, Develop, Code, Python, Data, Build

Data Developer - Associate

Job Summary

Python / Big Data developer (range of junior and more senior) to work within our team on our client site in London to build the data ingest pipeline into a Hadoop big data platform. Role is part of a large international Big Data programme with hundreds of varied data feeds to be ingested over the life of the programme.

Key Responsibilities

* Develop / code and test big data capability based on the design supplied
* Align algorithms with relevant industry standards
* Work with modern devOps / open source development, build & continuous integration environment

Mandatory Skills and Experience Required

* Good Python 2 skills essential
* Good Apache Spark skills essential including Python integration with Spark
* Software Engineering/Delivery experience essential, with experience working on large software development projects utilising source control.
* Scala skills as an alternative to Python will be considered
* Ability to manage large volumes of data from multiple sources
* Knowledge of approach data structures for algorithms for efficient ingest of e.g. large scale time series datasets, batch, real-time etc
* Good time management to complete committed tasks to the set deadlines
* Good communication to engage and interact with the clients teams directly

Similar jobs

Similar jobs