This job has expired

Senior Data Engineer

Closing date
15 Sep 2021

View more

Technology & New Media
Contract Type
You need to sign in or create an account to save a job.
Methods Analytics is currently recruiting for a Senior Data Engineer to join our team on a permanent basis. This role will require flexibility to travel to client sites, and is preferable to be based in Sheffield but can be based in Bristol or London.Methods AnalyticsMethods Analytics exists to improve society by helping people make better decisions with data. Combining passionate people, sector-specific insight and technical excellence to provide our customers an end-to-end data service. We use a collaborative, creative and user centric approach data to do good and solve difficult problems. And ensure that our outputs are transparent, robust and transformative.

We value discussion and debate as part of our approach. We will question assumptions, ambition and process - but do so with respect and humility. We relish difficult problems, and overcome them with innovation, creativity and technical freedom to help us design optimum solutions. Ethics, privacy and quality are at the heart of our work and we will not sacrifice these for outcomes. We treat data with respect and use it only for the right purpose. Our people are positive, dedicated and relentless. Data is a vast topic, but we strive for interactions that are engaging, informative and fun in equal measure. But maintain a steely focus on outcomes and delivering quality products for our customers.

RequirementsAs a Senior Data Engineer, you will work with other members of the delivery team across a mix of large and small projects and be responsible for translating data into valuable insights that inform decisions for small to large transformation projects and programmes.

Working with other members of the delivery team you will be responsible for identifying and using the most appropriate analytical techniques, developing fit-for-purpose, resilient, scalable and future-proof data services that meet user needs and design and write and iterate code from prototype to production-ready. This will frequently involve communicating effectively across organisational, technical and political boundaries to understand the context and how to make complex and technical information and language simple and accessible for non-technical audiences.

The Senior Data Engineer will
  • Experience with NoSQL type environments, Data Lakes, Lake-Houses (Cassandra, MongoDB or Neptune)
  • T-SQL Development experience including debugging & troubleshooting
  • Big Data Frameworks experience, such as Hadoop and Apache Spark
  • Have experience programming in Python, Scala or Java
  • Experience with Pandas data validation, manipulation, merging, joining and at time visualisation
  • Experience with Relational Database and Data Warehousing experience such as SQL Server and/or Azure SQL
  • Experience processing large volumes of structured/semi-structured data (mainly CSV/JSON)
  • Knowledge of data cleaning, wrangling, visualization and reporting, with an understanding of the best, most efficient use of associated tools and applications to complete these tasks
  • DevOps experience, such as using Git, CI/CD and Unit Testing
  • Understanding of distributed computing, columnar type databases, partitioning, map reduction
  • Have cloud based experience, preferably with AWS and/or Azure
  • Create effective data visualisation, appropriate to the audience
  • Have an ability to translate business requirements into technical specifications
  • Have attention to detail and ability to QA own and other team member's work
  • Provide training, support and mentoring to a team of analysts and helping to grow the development team
  • Have good experience with ETL
  • Infrastructure, Azure Data Factory / SSIS, SQL (On-prem/Cloud),
Have good experience with Analytical/Reporting
  • SQL (On-prem/Cloud), Analysis Services / Tabular Data Model, Power BI/Qlik Sense/Tableau, T-SQL
Understand analytical tools; you are numerate. Be aware of and keep up to date with advances in digital analytics tools and data manipulation products. Collect, collate, cleanse, synthesise and interpret data to derive meaningful and actionable insights.Demonstrable understanding of how to expose data from systems (for example, through APIs), link data from multiple systems and deliver streaming services.A good understanding of Data Governance principles and the safe handling and processing of Personal Identifiable DataProduce data models and understand where to use different types of data models. Know how to ensure that risks associated with deployment are adequately understood and documented.
Desirable Skills & Experience
  • Experience of working in a consultancy
  • Knowledge or and experience in SDLC or a software development background
  • Streaming and real-time data
  • Experience with containerisation (Docker, Kubernetes, AWS ECS/EKS, Redshift)
  • Experience with serverless architecture
  • Knowledge of statistics principles necessary to interpret data and apply models. For example, knowledge of errors and confidence intervals to understand whether a relation seen in the data is real.
  • Experience of creating PowerBI solutions and dashboards from row level data including data structure optimisation through to visualisation and dashboard creation.
  • Have experience in SQL Server Integration Services (SSIS)
  • Exposure to high performing, low latency or large volume data systems (i.e. 1 billion+ records, terabyte size database)
  • Exposure to iterative/agile development methodologies such as SCRUM
  • Knowledge of Healthcare data, specifically NHS Data sources such as HES, SUS PbR
BenefitsMethods Analytics is passionate about its people; we want our colleagues to develop the things they are good at and enjoy.By joining us you can expect
  • Autonomy to develop and grow your skills and experience
  • Be part of exciting project work that is making a difference in society
  • Strong, inspiring and thought-provoking leadership
  • A supportive and collaborative environment
As well as this, we offerDevelopment access to LinkedIn Learning, a management development programme and training

Wellness 24/7 Confidential employee assistance programme

Social - office parties, pizza Friday and commitment to charitable causes

Time off 25 days a year

Pension Salary Exchange Scheme with 4% employer contribution and 5% employee contribution

Discretionary Company Bonus based on company and individual performance

Life Assurance of 4 times base salary

Private Medical Insurance which is non-contributory (spouse and dependants included)

Worldwide Travel Insurance which is non-contributory (spouse and dependants included)
You need to sign in or create an account to save a job.

Get job alerts

Create a job alert and receive personalised job recommendations straight to your inbox.

Create alert