Big Data Engineering Lead - Hive & Hadoop, Java, Spark and Python

Spargonet Consulting Plc
United Kingdom
£600 - £700 per day
25 Sep 2017
03 Nov 2017
Contract Type
Full Time
Big Data Engineering Lead - Hive & Hadoop, Java, Spark and Python - £600-£700pd - London Spargonet Consulting, an IT Services Consultancy, is currently working with a world-wide leader in mobile satellite communications and we are seeking an experienced Cloud Big Data engineering lead to drive forward a new bleeding edge open source based big data initiative. You will work with a range of stakeholders across a variety of departments providing a new Big Data platform. This role is a hands on and you will lead / guide the data engineering team in developing a solution based on Hive & Hadoop, Java, Spark and Python. In order to accelerate development, we will need to put a CI/CD pipeline in place therefore any experience in CI/CD and DevOps would be beneficial. Years of experience:5+ years working as a Big Data Lead/Architect in a commercial environment. Mandatory skills & commercial experience: Python Spark Hadoop (HDFS: HIVE; HQL) Highly desirable Skills/experience: KAFKA Oozie Flume PySpark Shell scripting Streaming Batch and micro-batch processing Desirable Skills & experience: Ambari; Object storage, Postgres,DWH/BI knowledge, PLSQL, SQL, Oracle/RDBMS experience. Spargonet Consulting Plc is a leading IT consultancy with over thirty years pedigree and experience of supplying IT services to household name blue chip clients within a range of business sectors. By joining the personable team at Spargonet, you become a valued member of our personnel with good prospects of a rewarding and challenging opportunity. All applications welcome for an informal and confidential discussion.
This job was originally posted as