Big Data QA Engineer

Rullion Niche
United Kingdom
£80k - £85k pa
29 Sep 2017
03 Nov 2017
Contract Type
Full Time
One of the most popular international brands is looking for a passionate Big Data Engineer who will join their Big Data Team on a permanent basis to head up a range of 'greenfield' projects leading the brand towards a new era of development. It is an exciting opportunity for highly experienced and passionate data enthusiasts who seek a challenge and want to put their expertise to good use. My client is looking for skilled individuals who: - Will ensure Big Data Team produce high performing and stable applications to allow complex processing of large volume of data - Review and test the quality of end-to-end applications and feed output insights back to business systems - Work closely with Data Engineering Team providing quality checks throughout the process of Data Integration - Provide a QA perspective on best practice for the agile development of applications in collaboration with Data Engineering team - Proven experience in designing, building and managing applications to process large amounts of data within Hadoop ecosystem - Substantial experience with performance tuning applications on Hadoop - Experience building systems for real time data processing in Spark Streaming or Storm - Expert level in using Spark, Yarn, Hive and Oozie - Strong Python and Scala programming ability - Working knowledge of HBase, Solr, Kafka and Flume - Test automation and DevOps experience Experience in Cassandra, ElasticSearch and Flink is desirable. What the company has to offer in exchange for those skills? An excellent package consisting of: -basic pay of £80,000 -very attractive bonus (performance-related) -flexible working -very attractive pension scheme -28 days holiday -life insurance for the candidate and their partner -childcare vouchers, summer holidays, discounts on company's products -opportunities to progress Our client welcomes applicants from European Union countries and is happy to help with relocation. Do you want to be a part of something great? Apply now.
This job was originally posted as