Principal Software Engineer - Big Data

United Kingdom
12 Nov 2017
18 Nov 2017
Contract Type
Full Time
Sainsbury's, one of the UK's largest retailers, is investing heavily indigital innovation. We have built a centralised Data Platform in thecloud which allows business users to make better and faster decisions,supported by accurate and up-to-date data from the business. The team isgrowing rapidly and looking for talented colleagues to continue todeliver an ambitious and market leading data platform that lives up toSainsbury's industry leading reputation.We are looking for talented Principal Data Platform Engineers to leadthe design, build, and automate activities for this Data Platform. Youwill work closely with other Data Engineers, Data Scientists, and DevopsEngineers across multiple platforms and technologies to create a highlyscalable, secure, and performant data platform.What I need to do Design, test, and deploy large scale distributed systems usingengineering best practices in the enterprise production context Design smart and secure ways of storing, analysing, and processingcomplex data in the cloud, including in real-time Care about your craft, be aware of new technologies, and be keen touse them when appropriate Feed your insights to the product team to continuously improve theplatform Be the technical lead of an agile development team Be diligent and positive about issue tracking, system monitoring,security, auditing, and other ways of ensuring the quality of theplatform and the processes around it Provide third level support for production issues following the"you build it, you fix it" philosophy Define your career path, grow, and learnWhat I need to know Technical leadership experience in an enterprise Hadoop productionenvironment Distributed computing, its advantages and disadvantages in Big Dataanalytical applications Cloud computing and related challenges around security, bandwidth,etc. Hadoop application architecture, understanding batch vs. streaming Understanding statistics and data science to work closely withbusiness analysts Service oriented architecture and APIs Unit, regression, and integration testing Version control Agile software development DevOps and infrastructure-as-codeTechnologies we are using: Kafka, Spark, Hadoop, Hive, Impala AWS, Terraform, Ansible Scala, Java, R, PythonWhat I need to show Communication and Influencing: Uses range of techniques to influence, adapts to situationAnalytical Thinking: Pushes boundaries in solving problemsAptitude to Learn: Actively seeks feedback from multiple sources Contributes to wider community in own area of expertiseTeam Work: Supports a collective effort to resolve problems Uses strengths of team to deliver increased valueLeadership and Mentoring: Values differencesCommitment and Planning: Delivers ahead of expectationsResources available to me Line manager providing on-going support through 121's and SMARTobjectives Agile coach providing on-going support in terms of Agile ways ofworking Wider development community sharing knowledge and supportWhat decisions I can make Lead on decisions regarding technology choices for multiple teams Shape the technical landscape using your experience Leads on architectural decisions across multiple teamsTo find out more information and to apply, please click the APPLY button - provided by Dice AGILE, AGILE SOFTWARE DEVELOPMENT, AWS, BIG DATA, CLOUD, CLOUD COMPUTING, FIX, HADOOP, JAVA, PYTHON, SCALA, STATISTICS