Remote Apache Airflow Specialist – ETL

Employer
Recruitment Revolution
Location
Birmingham
Salary
£70,000 Benefits Package & Fully Remote Working
Closing date
18 Mar 2021
You need to sign in or create an account to save a job.

Job Details

Excellent fully-remote technology role for an Apache Airflow Specialist to join a global player in providing data insights to the advertising & media industry.

Role Info:

Remote Apache Airflow Specialist – ETL
UK Remote
£70,000
Plus Benefits Package & Full Remote Working

Who we are:

We are a provider of SaaS/software to advertising and media companies, providing the most influential agencies, media owners and planners with innovative cloud-based tools to help create, plan and predict the most successful media campaigns. With over 50 years of experience providing data and analytical tools for the marketing and advertising industry, our easy-to-use software products and solutions support over 8,000 databases, making it the industry’s most trusted third-party data analysis software globally.

Apache Airflow Specialist Role Summary:

Reporting to the Engineering Resource Manager in the role of Apache Airflow Specialist, you will be responsible for designing, expanding, automating and optimizing our data pipeline architecture, as well as optimising data flow and collection.

You will be responsible for the Airflow architecture to design, build and manage automated data pipelines built upon environments in AWS and pioneer ways of working that other team members can adopt

Using Apache Airflow for respondent survey pipeline building, you will work to automate components of a manual load and then add these to the pipeline. The aim is to reduce manual intervention, and increase processing speed, so that we can repeatedly process more data, at higher frequencies in the future. Where needed you may choose to add manual human tasks to the automation workflow.

You will work with Data Engineers, Python Engineers and Product Managers within Agile to deliver secure, performant and maintainable data automation. You will use best-practice continuous integration and continuous deployment methodologies to ensure that the build and deployment pipelines are fast, robust and secure. You will champion good code quality and architectural practices.

About You:

+ Significant experience of large scale implementation using Apache Airflow
+ Be an expert in the concept of DAGs (Directed Acyclic Graph) and Operators to schedule jobs
+ Working knowledge of message queuing, stream processing, and highly scalable “big data” data stores.
+ Experience of manipulating, processing and extracting value from large disconnected datasets.
+ Prior experience with customer data platforms.
+ Experience in performing root cause analysis on internal/external data and processes.
+ Prior experience with data analysis and data warehousing
+ Technical expertise with data models, data mining, and segmentation techniques
+ Proficiency in scripting languages (especially Python)
+ Be able to investigate current data loading procedures, planning pipelines and required steps in order to automate data extraction, transformation, and loading (ETL) processes
+ Proficiency in understanding of GitHub for source code repositories to maintain daily operation, integrity and security of source code.
+ Experience of conducting code reviews against acceptance criteria
+ Knowledge of Amazon Web Services (AWS) infrastructure & services e.g. Redshift, EC2, RDS, S3, Lambda, EMR, Batch or Athena
+ Excellent Linux scripting skills
+ Experience with data modelling, data processing and ETL
+ Passionate about the power of data to drive better business outcomes for our customers.
+ A working knowledge of SQL, query authoring and a working familiarity with a variety of relational databases.
+ Experience with Agile methodologies and change management i.e. JIRA and be able to define technical acceptance criteria for stories
+ Experience working with external partners to drive product delivery.

Personal Attributes:

+ Excellent problem-solving skills
+ Proven ability to work effectively in a distributed working environment
+ Outstanding written and verbal communication skills
+ Ability to estimate effort of own tasks and those of others in expertise domain
+ Organized, detail-oriented, and deadline-driven
+ Strong interpersonal skills and the ability to work proactively, independently and as a team player
+ Ability to work efficiently and productively in a fast-paced environment
+ Willingness to learn new skills
+ Be confident with numbers

Interested? Apply here for a fast-track path to the Hiring Manager.

Application notice… We take your privacy seriously. When you apply, we shall process your details and pass your application to our client for review for this vacancy only. As you might expect we may contact you by email, text or telephone. Your data is processed on the basis of our legitimate interests in fulfilling the recruitment process. Please refer to our Data Privacy Policy & Notice on our website for further details.

If you have any pre-application questions please contact us first quoting the job title & ref. Good luck, Team RR.

Company

We’re Talent Acquisition Specialists that founded change in 2005. Since then we’ve helped over 2500 clients grow, prosper and lead.

# Our Story

Frustrated by poor experiences with traditional agencies, our founders (just two regular candidates), decided that the outdated industry needed modernising and a new balance of power. In 2005, a new kind of agency model was born, putting the client and candidate at the heart of the experience whilst removing the pushy sales, schmooze and high fees.

# What makes us different?

Aside from a sensible fee model, custom technology and a direct unhindered path to candidates we…

…don’t sell candidates and we don’t sell jobs: we facilitate relationships and champion the process of ‘organic hiring’ to help create stronger and longer-lasting engagements.

# Who we work with

With an industry reputation for delivering results we are the go-to talent finders for over 2500 clients. We work with everyone from tech start-ups to global brands who all demand the best service and talent.

From business owners hiring 2 people a year to Internal Recruiting teams hiring 200+ people a year, RR sources talent across all sectors and levels.

# Reputation

Our expertise have also been called upon by some of the leading job boards including the UK’s No1. Reed.co.uk.

Recruitment Revolution is a member of the REC with a 100% compliance pass rate and holds a Feefo 5* Gold Award for Service.

For more information please contact Team RR on 0800 294 3113 or visit https://www.recruitmentrevolution.com

Find Us
Website:
Telephone
01344844064
Location
Castle Hill House
12 Castle Hill
Windsor
Berkshire
SL4 1PD
United Kingdom
You need to sign in or create an account to save a job.

Get job alerts

Create a job alert and receive personalised job recommendations straight to your inbox.

Create alert