Data Engineer

Cranford, UK
Closing date
14 Oct 2020

View more

Technology & New Media
Contract Type
You need to sign in or create an account to save a job.
Data Engineer (Azure)

Looking for an Azure Data Engineer, to join a Start-Up working on a financial risk product. This solution will create a risk and control data standard library for front office/back office client files such as Cash equities, FX, Algo trading (from various investment banks) with complete data analysis for risk identification, monitoring, and reporting dashboards. You should be a strong communicator at all levels and be able to demonstrate where you have influenced in smaller teams.

What will you be doing?

· Developing pipelines to process client risk and control files from the BLOB storage (in various formats such as Excel, JSON, CSV, Flat File) using Python/PySpark and deploy as micro-services.

· Cleansing, transforming, networking (through NLP engine), and analyze for KPI reporting Develop Spark ETL (using Python/PySpark) and deploy in the Azure platform (using Databricks for development and data orchestration for the pipeline).

What technology will you work with?

· Azure, Gen 2, Blob, Databricks, Azure Kubernetes

· Python, Scala, PySpark & API'S

· Spark, CI/CD

Please send your application via the advert or alternatively send your CV to
You need to sign in or create an account to save a job.

Get job alerts

Create a job alert and receive personalised job recommendations straight to your inbox.

Create alert