This job has expired

Data Engineer

Employer
BRT Consulting Limited
Location
UK
Salary
Competitive
Closing date
15 Sep 2021

View more

Sector
Technology & New Media
Contract Type
Permanent
You need to sign in or create an account to save a job.
DATA ENGINEER - UK/US or BELGIUM BASED - £120 - £135K + BENEFITS

POSITION SUMMARY



Data Engineer with experience in building high-performing, scalable, enterprise-grade platforms. Hands-on experience in platform/product development is a must. The Data Engineer will be responsible for dealing with all aspects of the data engineering/processing on a data pipeline. Your goal is to guarantee the reliable extraction, transformation and loading of data, to manage databases, develop and implement software to establish relationships between the different data sources and guarantee the quality and integrity of the data.

The ideal candidate must be a problem solver and have expertise in Big Data technologies, Azure stack. The ideal candidate must have hands-on experience inefficient data loading, storing, cleaning, and processing experience. Candidates must be familiar with various technologies and have a good understanding of their relative strengths and shortcomings.

RESPONSIBILITIES


  • Design and develop high-volume, low-latency platforms/applications for mission-critical systems, delivering high-availability and performance.
  • Understand business requirements and actively provide inputs from a Data perspective.
  • Understand the underlying data and flow of data.
  • Build simple to complex pipelines & dataflows.
  • Work with other Azure stack modules like Azure Data Lakes, Azure Databricks, Azure Cosmos DB, etc.
  • Recognize and adapt to the changes in processes as the project evolves in size and function.


SKILLS NEEDED


  • Strong analytic skills related to working with structured and unstructured datasets.
  • Proficient in writing T-SQL Stored Procedures, Functions, Cursors, Tables, Constraints, Views, Indexes & Sequence. Experience in data scraping from website and ingest to cloud data platform will be an added advantage.
  • Strong knowledge in analyzing performance issues, optimizing performance in ADF & Azure SQL
  • Excellent interpersonal/communication skills in English (both oral/written) to communicate at various levels with clarity & precision.
  • Knowledge of the pharma domain and understanding of the clinical trial process will be an added advantage.



QUALIFICATIONS NEEDED

  • Bachelor's degree or higher in Computer Engineering, Computer Science or related field
  • Seven (7) + years of experience in a data-engineering role.
  • Four (4) + Years of experience in programming languages (e.g., Spark, Python, C#).
  • Two (2) + years of hands-on experience on Azure Data Factory V2, which covers DF Pipeline development, deployment, administration & management of ARM template packages.
  • Knowledge of the pharma domain and understanding of the clinical trial process will be an added advantage.


This is an excellent opportunity to join an exciting company going through a period of growth. For more information and a full job description, please contact Ben Turner at BRT Consulting.
You need to sign in or create an account to save a job.

Get job alerts

Create a job alert and receive personalised job recommendations straight to your inbox.

Create alert