Data Engineer - Python

Employer
The JM Longbridge Group
Location
UK
Salary
Competitive
Closing date
11 Jun 2022

View more

Sector
Technology & New Media
Contract Type
Permanent
Hours
Full Time
Global Analytics Firm is hiring for a Data Engineer for their team based in London. This is a permanent role based in the City, offering a salary of £60K - £80K.

Responsibilities include:
*Design, develop, test, and deploy data integration processes (batch or real-time) using tools such as Microsoft SSIS, Azure Data Factory, Databricks, Matilion, Airflow, Sqoop, etc.
*Create functional & technical documentation - e.g. ETL architecture documentation, unit testing plans and results, data integration specifications, data testing plans, etc.
*Provide a consultative approach with business users, asking questions to understand the business need and deriving the data flow, conceptual, logical, and physical data models based on those needs. Perform data analysis to validate data models and to confirm ability to meet business needs.
*Design and develop enterprise self-service analytic solutions, business intelligence reports, visualisations and best practice standards. Toolsets include but not limited to: SQL Server Analysis and Reporting Services, Microsoft Power BI, Tableau and Qlik.

Skills and Experience:

*At least 5 Years industry implementation experience with data integration tools such as Microsoft SSIS, Azure Data Factory, Databricks, Glue, Step Functions, Airflow, Apache Flume/Sqoop/Pig, etc.
*Some Consulting experience preferred
*Bachelor's degree or equivalent experience, Master's Degree Preferred
*Strong data warehousing, OLTP systems, data integration and SDLC
*Experience in big data frameworks & working experience in Spark or Hadoop or Hive (incl. derivatives like pySpark (prefered), SparkScala or SparkSQL) or Similar, along with experience in libraries / frameworks to accelerate code development
*Experience using major data modelling tools (examples: ERwin, ER/Studio, PowerDesigner, etc.)
*Experience with major database platforms (e.g. SQL Server, Oracle, Azure Data Lake, Hadoop, Azure Synapse/SQL Data Warehouse, Snowflake, Redshift etc.)
*Strong experience in orchestration & working experience in either Data Factory or HDInsight or Data Pipeline or Cloud composer or Similar
*Understanding and experience with major Data Architecture philosophies (Dimensional, ODS, Data Vault, etc.)
*Understanding of modern data warehouse capabilities and technologies such as real-time, cloud, Big Data.
*Understanding of on premises and cloud infrastructure architectures (e.g. Azure, AWS, GCP)
*1-3 years development experience in decision support / business intelligence environments utilizing tools such as SQL Server Analysis and Reporting Services, Microsoft's Power BI, Tableau, looker etc.

Please apply for immediate interview!

The JM Group is operating and advertising as an Employment Agency for permanent positions and as an Employment Business for interim / contract / temporary positions. The JM Group is an Equal Opportunities employer and we encourage applicants from all backgrounds

Get job alerts

Create a job alert and receive personalised job recommendations straight to your inbox.

Create alert