Big Data Engineer
Data Engineer - Good Development Experience - ETL Tooling - Hadoop - MapReduce - Hive - HBase - Agile - General data processing
My Leeds based client has an immediate need for a contract Data Engineer, it is essential that candidates have good development experience as it is a base skill for this role. In addition to this candidates will need to have skills covering - ETL tooling (Talend/Pentaho/Informatica), Spark, experience; Good knowledge and experience of Hadoop MapReduce, Hive, HBase and general data processing.
My client are now in the process of re-building their Batch data-flows into standard ETL tooling and re-building the core ingestion and Feature Store/Mart generation systems. Additionally, the client is commencing a migration to utilising significantly more real-time data by leveraging the Kafka Confluent platform. This role is to act as a key part of these re-engineering tasks. You will also need to assist in augmenting the current batch processes to take advantage of streaming data, enabling real-time analysis and reporting.
Please forward your CV for immediate consideration.
This job was originally posted as www.cwjobs.co.uk/job/79983253