ETL Big Data Developer Hadoop/Python/Spark- Ipswich - £D.O.E

Recruiter
Sanderson
Location
Ipswich
Salary
40000.0000
Posted
05 Feb 2017
Closes
05 Mar 2017
Contract Type
Permanent
Hours
Full Time

ETL Big Data Developer (Hadoop/Python/Spark)- Ipswich - £D.O.E

Role Profile:

My client, a large profession organisation based in Ipswich, are seeking an experienced ETL Big Data Developer. This role is a hands-on specialist technical role which will be supoorting my client's data warehousing systems.

You should have strong technical experience with Python development, Spark and Hadoop ecosystem.

Your Responsibilities:

  • Develop and support the Cloudera Hadoop implementations in Data Services.
  • Good knowledge of testing in a Big data environment.
  • Developing, testing and implementing components for the existing data warehousing solutions using industry best practice techniques.
  • Daily process and job checks and fixes on SQL Servers and other reporting systems.
  • To work as part of a team assisting and supporting other team members.
  • To provide support and assistance to other members and departments of the business as needed. This includes, but is not limited to software developers, underwriting, software testing, marketing and management.
  • Troubleshooting, debugging and improving existing processes.
  • Produce technical and user documentation for processes and procedures.

Essential Skills and Experiences:

Experiences:

  • Strong experienced in Python and SPARK development.
  • Experience working on Hadoop environments - for example Oozie, HIVE, Impala, ELK etc...
  • Strong experience in Data Ingestion and processing on Big Data.
  • ETL and Data Warehousing (Kimball methodology)
  • Report and Dashboard Development using Big Data tools and SQL Server stack
  • Agile methodology
  • Data Modelling

Skills:

  • Python Pyspark
  • SPARK
  • oozie/ HIVE/ Impala/ ELK or others
  • MS SQL Server 2008 r2/2012/2014
  • Industry qualifications (CCA/CCP/MCSA/MCSD)
  • Developing ETL processes

If this sounds like the career choice for you then please apply below or for more information, please get in touch with Hassan Lenga-Kroma at Sanderson Recruitment on or email

ETL Big Data Developer (Hadoop/Python/Spark)- Ipswich - £D.O.E