Data Engineer

Recruiter
BAE Systems Applied Intelligence
Location
United Kingdom
Posted
11 Nov 2017
Closes
17 Nov 2017
Contract Type
Permanent
Hours
Full Time
The Applied Intelligence division of BAE Systems delivers solutionswhich protect and enhance the connected world. Everything we do createsa safer future. We want to solve problems for our customers and by bringing togethergreat minds, we can work together to make the world a safer place.Job Summary:We have a requirement for a Python / Big Data developer to work withinour team on our client site in London to build the data ingest pipelineinto a Hadoop big data platform. This role is part of a large,international Big Data programme with hundreds of varied data feeds tobe ingested over the life of the programme. The candidate needs to beenthusiastic, ambitious, a quick learner and a team player willing tojoin a larger development team.Key Responsibilities: Develop / code and test big data capability based on the design supplied Align algorithms with relevant industry standards Work with modern devOps / open source development, build & continuous integration environment Mandatory Skills and Experience Required: Good Python 2 skills essential Good Apache Spark skills essential including Python integration with Spark Software Engineering/Delivery experience essential, with experience working on large software development projects utilising source control. Scala skills as an alternative to Python will be considered Other Desirable Skills and Experience: Good Scala skills desirable including integration with Spark Knowledge of Hadoop based technologies including Apache Hive and Impala Ability to manage large volumes of data from multiple sources Knowledge of approach data structures for algorithms for efficient ingest of e.g. large scale time series datasets, batch, real-time etc Good time management to complete committed tasks to the set deadlines Good communication to engage and interact with the clients teams directly #AI-DICE Security Clearance is required for this vacancy. If you are notcurrently Security Cleared, you will need to be eligible for this andwilling to go through the process. For more guidance on NationalSecurity Vetting please click here. About BAE Systems Applied Intelligence: We help nations, governments and businesses around the world defendthemselves against cyber crime, reduce their risk in the connectedworld, comply with regulation, and transform their operations. We dothis using our unique set of solutions, systems, experience andprocesses. Our success is down to our people. The changing nature of our businessmeans that we're constantly looking for the brightest talent to help usfulfil our ambitions. As an experienced professional, we'll entrust youwith responsibility; this means that you'll have client contact, varietyand support from day one. We'll encourage and support you to develop your skills and reward youas you grow. Whatever your area of expertise, you'll be much more thanjust a job title; you'll be an integral part of the business where yourindividual contribution makes a difference every day. Great mindsdeserve great rewards, so we also offer a very competitive salary andbenefits package. Diversity and inclusion are integral to the success of BAE SystemsApplied Intelligence. Staying competitive in today's global marketplacerequires an organisational culture where employees with varyingperspectives, skills, life experiences and backgrounds - the best andbrightest minds - can work together to achieve excellence and realiseindividual and organisational potential. We also welcome discussionsabout flexible working. Division Overview: UK Services UK Services delivers IT Services and Consultancy to AppliedIntelligence clients based primarily in the UK. We divide our clientsinto 3 market segments; National Security, Government and EnterpriseServices. We differentiate ourselves through recognised expertise inData, Security, Digital Media and Business Solutions. Help us secure a connected world by being an unseen hero. Apply now andbe inspired. - provided by Dice APACHE, BIG DATA, HADOOP, PYTHON, SCALA, SOFTWARE ENGINEERING