Big Data Engineer (Hadoop, Java)

Intapeople Limited
£475 - £525 per day
05 Oct 2017
02 Nov 2017
Contract Type
Full Time
Big Data Engineer (Hadoop, Java) 12-month contract (multi-year) Slough (with some home ad hoc working options) Up to £525pd IntaPeople are seeking a talented Big Data Engineer, to work with one of the world`s leading storage companies; this is a varied and exciting role working on next generation products. The successful candidate will work hands-on with the team to develop a solution high-volume sensor data processing pipeline based on open source big data technologies, including Hadoop (Hive & Spark), Kafka, Docker, and Python. We`re also looking for - - Hands-on background in Hadoop 2.0+ including Hive and Spark - Java programming experience - Data warehousing experience (ETL, star schema, etc.) - Experience with stream processing (e.g. Kafka, Spark Streaming, Storm, etc.) Desired skills also include - Python and PySpark programming - Docker - AWS or IBM Bluemix experience - Jenkins - Hadoop administration experience, including YARN and HDFS admin. Other plus points include any knowledge of Tableau, Postgres, Kubernetes, Hadoop ecosystem technologies such as Ambari, Oozie, Flume, and Sqoop. Ideal candidates will have referenceable experience building similar pipelines at moderate scale (10-100TB of live data) that power user-facing alerting and dashboarding. In order to apply for this position please apply or call Jonathan Edwards on [Phone number removed] for a discrete conversation regarding the role and for immediate consideration. ``The services advertised by IntaPeople are those of an Employment Agency and an Employment Business``
This job was originally posted as