Senior Data Engineer - Data Science / Python / Java / Big Data

Recruiter
e resourcing Limited
Location
United Kingdom
Salary
£500 - £550 p day
Posted
07 Oct 2017
Closes
07 Nov 2017
Contract Type
Contract
Hours
Full Time
Senior Data Engineer - Data Science / Python / Java / Big Data As a Senior Data Engineer / Data Scientist within Big Data, you will be the technical lead for the data engineering part of the team, working closely with both the data science and the consultants to understand both internal and external customer needs and develop ground breaking solutions You will: Build and maintain cloud data infrastructure: storage, pipelines, analytics platforms Support data scientists to design and handle very large datasets, understanding data processing at scale Deliver analytical solutions, analysing large and complex data sets using multiple technologies (SQL, Big Query, Big Table, Cloud Services). Understand customer requirements and define tailor made solutions Create and develop data products and implement production tools Clearly and confidently present complex data architectures in a simple and engaging manner Visualise and deliver analytical results in insightful, interesting and interactive ways using various technologies (Powerpoint, Qlikview, HMTL, Javascript, Tableau, other) Proactively investigate and discover new techniques, technologies and data sources to enhance Big Data capabilities Be an inherent part of the team, helping design and drive both short and long-term strategies You will have: Experience with software engineering, big data and distributed platforms. Python programming advanced level. Java programming capability. Batch and streaming large-scale data processing (Apache Beam, Apache Spark) and advanced SQL. NoSQL, Big data analytics platform, Massively parallel processing engines (BigQuery, Impala, BigTable, HBase). Good understanding of different types of big data storages. Message brokers (Kafka, Pub/Sub). Virtual environments, containers, advanced distributed version control system. Git guru. Ability to write requirements specification, mission statement and documentation. Team player, happy to collaborate ideas and contribute collectively for a common goal. Excellent problem solver with real curiosity and drive. Happy to regularly take on new challenges. Motivated and quick to pick up any newly required skills. Please send a CV detailing the required experience for consideration
This job was originally posted as www.jobsite.co.uk/job/959275926