Data Engineer (Azure)
Looking for an Azure Data Engineer, to join a Start-Up working on a financial risk product. This solution will create a risk and control data standard library for front office/back office client files such as Cash equities, FX, Algo trading (from various investment banks) with complete data analysis for risk identification, monitoring, and reporting dashboards. You should be a strong communicator at all levels and be able to demonstrate where you have influenced in smaller teams.
What will you be doing?
· Developing pipelines to process client risk and control files from the BLOB storage (in various formats such as Excel, JSON, CSV, Flat File) using Python/PySpark and deploy as micro-services.
· Cleansing, transforming, networking (through NLP engine), and analyze for KPI reporting Develop Spark ETL (using Python/PySpark) and deploy in the Azure platform (using Databricks for development and data orchestration for the pipeline).
What technology will you work with?
· Azure, Gen 2, Blob, Databricks, Azure Kubernetes
· Python, Scala, PySpark & API'S
· Spark, CI/CD
Please send your application via the advert or alternatively send your CV to email@example.com.