Big Data Engineer - Hadoop, Kafka, TDD, BDD, Spark, Agile

People Source
United Kingdom
78000 - 80000 per annum + Excellent benefits
12 Nov 2017
18 Nov 2017
Contract Type
Full Time
Big Data / Cloudera Hadoop / Spark / Kafta / Scala / Python / Unix /Agile / Central London 78,000-80,000 + fantastic benefits package including healthcare,Pension and company bonus A fantastic opportunity has arisen for a Big Data Engineer to join aglobal giant The company A market leader, the company has accomplished a strong reputation as anemployer of choice. Operating in over 25 countries, the company isalways committed to deliver useful and inspiring innovation. A brandthat loves change - if it's not happening naturally then they willcreate it themselves. Key responsibilities of the role: * Expert level experience in designing, building and managingapplications to process large amounts of data in a Hadoop ecosystem; * Extensive experience with performance tuning applications on Hadoopand configuring Hadoop systems to maximise performance; * Experience building systems to perform real-time data processingusing Spark Streaming and Kafka, or similar technologies; * Experience with common SDLC, including SCM, build tools, unittesting, TDD/BDD, continuous delivery and agile practises * Experience working in large-scale multi tenancy Hadoop environments You'll have experience of the following: * Extensive experience with Hadoop ecosystem (Spark, Hive/Impala,HBase, Yarn); desirable experience with Cloudera distribution; * Strong software development experience in Scala and Python programing languages * Experience with Unix-based systems, including bash programming * Experience with columnar data formats * Experience with other distributed technologies such as Cassandra,Solr/ElasticSearch, Flink, Flume would also be desirable. The package 78k-80k + fantastic benefits package including healthcare, Pension andcompany bonus Role is based in London ***If you are interested but your salary expectations exceed thislevel please do apply statin your requirements as there may be othersuitable roles*** People Source Consulting Ltd is acting as an Employment Agency inrelation to this vacancy. People Source specialise in technology recruitment across niche marketsincluding Information Technology, Digital TV, Digital Marketing, Projectand Programme Management, SAP, Digital and Consumer Electronics, AirTraffic Management, Management Consultancy, Business Intelligence,Manufacturing, Telecoms, Public Sector, Healthcare, Finance and Oil& Gas. - provided by Dice AGILE, BDD, BIG DATA, CLOUDERA, HADOOP, HBASE, PROGRAMME MANAGEMENT, PYTHON, SAP, SCALA, TDD, UNIX