Data Engineer (Hadoop, Spark, Hive) - Data Tribe

SKY Betting & Gaming
14 Feb 2018
21 Feb 2018
Contract Type
Full Time

Data Engineer (Hadoop, Spark, Hive) - Data Tribe

Data Tribe:

We're the Tribe that thinks outside the box as we put our minds to collecting, storing and analysing mountains of real-time data - all to help us design, build and support our next generation data platform.

Keeping our business lean and agile, we provide the insight, data science and CRM expertise our product teams need to make the right data-driven decisions.

The better we know our customers - the better we can anticipate and meet their changing needs.

Why not have a look at the Data Tribe video:

What you'll do:

SBG have an existing set of data pipelines into and out of the warehouse which are currently created in HiveQL and a company specific DSL. A significant number of these will be transitioned over an ETL tool-based approach with a lot of additional new data sources to be collected and integrated as well.

During the transition, the existing pipelines will require support and maintenance, a number of them will require refactoring into our commitidity ETL tooling, and a series of new pipelines based on the new pattern of work will be needed as well.

We already have a number of real-time event stream data flows at SB&G, but most are focused on per-market flows (e.g. changing bet prices in trading) rather than on customer events. We are starting to offer real-time personalised promotions to our customers and introducing stream based processing using Kafka, Spark Streaming and Kafka streams.

How you'll do it:
Good development experience is essential as it's a base skill in this area, along with being a quick learner as the Hadoop ecosystem is constantly evolving and

The following would be a requirement: ETL tooling (Talend/Pentaho/Informatica), Spark, Good knowledge and experience of Hadoop MapReduce, Hive, HBase and general data processing; previously part of an agile delivery team.

A key requirement is to show a desire to continuously learn and adapt to new technologies and requirements.

Why should you work for us?

At Sky Betting & Gaming we don't have teams we have Tribes. Each Tribe is made up of small, agile and autonomous squads who work collaboratively with a shared purpose.

So whether you join our Bet Tribe, Early Careers Tribe or anything in between, you will work with a group of people with raw energy, natural talent, and the kind of spirit that helps us think big, act bold, and change the game.

It all means that we've created the kind of workplace that wins awards such as a place on the prestigious list of Sunday Times 100 Best Companies to Work For.

Similar jobs

Similar jobs