Lead Data Engineer

Recruiter
I4 Recruitment Ltd
Location
London (Greater)
Posted
09 Nov 2017
Closes
16 Nov 2017
Sector
Engineering
Contract Type
Permanent
Hours
Full Time

Lead Data Engineer - London - Permanent - Competitive Negotiable Salary

We are working with one of the UK's leading Data Location businesses situated in the heart of the City. They are currently developing greenfield products and require a highly experienced Lead Data Engineer. As the Data Lead you will take responsibility for the design, performance, cost effectiveness, flexibility, integrity and security of data ingestion, enhancement, processing and delivery. There is a requirement to deal effectively and promptly with business requests for information, reports and providing subject matter expertise to strategic work streams.

Key focus.

  • Lead and build the Data Engineering Team
  • Support and extend current Data Processing Platform
  • Evolve Data Engineering Architecture
  • Hands on Development of new data extracts or feeds to internal and external business parties
  • Prototyping, ad hoc data extraction
  • Work closely with Data Science Function
  • Improving the effectiveness of the database tools and services
  • Ensuring all the data complies with legal regulations
  • Making sure the information is protected and backed-up
  • Regular reporting to the teams you work with
  • Monitoring database performance
  • Improving the technology used
  • Building new databases

Required Skills:

  • Python
  • ETL Development
  • AWS Cloud Knowledge
  • Apache Spark
  • AWS Data pipeline
  • Experience of SQL performance and query optimization
  • Working knowledge of:
    • AWS Redshift
    • Postgres
    • Column store databases

Desirable Skills:

  • Working with large datasets
  • Data analytic experience
  • Business Analyst exposure
  • BI Tool Experience
  • Agile
  • Jira
  • GitHub

This job was originally posted as www.jobsite.co.uk/job/959503721