Big Data Engineer (Hadoop)

Spencer Knight Recruitment Ltd
United Kingdom
£70,000 - £90,000 + Bonus + Excellent bens
25 Sep 2017
03 Nov 2017
Contract Type
Full Time
Big Data Engineer (Hadoop) This is an excellent opportunity to join a dynamic global organisation who are at the cutting edge of technology. We are looking for a Big Data Platform Engineer that will work on the managing our Big Data Hadoop platforms that includes the collecting, storing, processing and analysing massive data sets. The primary focus will be provide subject matter expertise for the plan, build and tuning of the Big data Hadoop environment to support our Big Data workloads. This includes diving into challenging technical problems, research and conduct testing to improve existing Big Data environment This new role will report to the European Head of Infrastructure and Information Security with particular emphasis on designing and implementing Big Data Hadoop solutions. Skills (ideally) - 3+ years experience in Big data technologies - Experience in management of Hadoop and Spark Clusters, Cloudera Hadoop will be a plus - Experience with Integration of Data from multiple data sources - Troubleshoot and resolve Data Pipeline related issues - Experience with Hadoop technologies like Map Reduce, Hive, HDFS, Oozie, Hue, Sqoop, Flume, Kafka, Zookeeper, Sentry - Experience with programming languages like Java, Pig, Python, Scala, MapR - Experience scripting for automation and config management (Chef, Puppet) - Exposure to AWS EMR, S3, RDS, Lamdda, Kinesis, SNS, SQS and Cloudwatch will be a plus - A general understanding of Industry Compliance and Regulations such as ISO27001, PCI-DSS and GDPR - Experience on databases and BI tools , such as HBase, MySQL, Oracle, Impala & Tableau Responsibilities: - Use your technical expertise to lead projects with the ability to design and build Big data solutions at scale, across multiple data centers, and cloud providers. - Providing subject matter expertise on Big Data and Hadoop based technologies - Build collaborative partnerships with business and technical leads to drive key big data initiatives. - Provide training and knowledge transfer to the team to widen their technical skills and understanding of new technologies - Support sales and consultative activities both internally and externally There are many excellent benefits to be gained from working for this truly international business, and here are just a few more! * Pension * Private medical insurance * Denplan * Season ticket loan * Life assurance (4 x salary)
This job was originally posted as