Lead Software Engineer (Java, Scala, C#, Big Data, AWS)

Brady Trading Ltd
United Kingdom
30 Sep 2017
04 Nov 2017
Contract Type
Full Time
Lead Software Engineer / Lead Data Engineer (Java, Scala, C#, Big Data, AWS) - London. A Lead Software Engineer / Lead Data Engineer (Java, Scala, C#, Big Data, AWS) is required to build and lead our new Data Team with the mission to develop new data-driven products and services adjacent to our existing technologies. The Data Team will collect, combine and process all the data from customers, markets, and relevant third-party sources. To this end, you will work closely with the Chief Data Officer, hire Data and Software Engineers, System Engineers, and Data Scientists to design, build and maintain a modern data processing service in the cloud. Lead Software Engineer / Lead Data Engineer (Java, Scala, C#, Big Data, AWS) - Key Skills: - Deep experience in designing and developing software with Java, Scala, C# or similar - Experience in working in a DevOps culture with CI and CD pipelines - Seven or more years relevant work experience - Experience in leading an Agile environment - Experience with Big Data technologies, e.g. Spark, Flink, Hadoop, Kafka, Kinesis, Event Hub - Cloud experience, ideally AWS and/or Azure - Experience in distributed event driven systems - Experience in various types of testing - Data Engineering skills - Solid Linux/Unix skills - Ability to switch from self-starter and team player to team leader as the team grows - Collaborative approach to problem solving and planning - Pride in your work Lead Software Engineer / Lead Data Engineer (Java, Scala, C#, Big Data, AWS) - Beneficial Skills - Serverless computing experience - Scala, Java - Spark, Flink, Storm - System Engineering skills - Experience with large datasets - Experience working with Data Scientists Lead Software Engineer / Lead Data Engineer (Java, Scala, C#, Big Data, AWS) - Responsibilities: - Design and deliver cloud based data services to store, process and analyse data - Use good practices, e.g. around data wrangling, processing, quality and measures - Leverage appropriate cloud services - Able to use real-world design patterns - Work with Data Scientists to integrate their outputs, e.g. machine learning models and large-scale data processing, into production environments - Integrate existing and external data sources - Work in a cross-functional team with Data and Software Engineers, and Data Scientists - Grow and lead a team building a culture of excellence and collaboration Lead Software Engineer / Lead Data Engineer (Java, Scala, C#, Big Data, AWS) - Education: - Relevant IT or Computer Science degree About you: You have built and delivered business critical data processing solutions in the cloud before. You are able to help design complex software and data architectures taking advantage of modern software development processes to iterate fast and develop a solid outcome that needs no hacking and hand-holding. You are comfortable when having well-reasoned conversations about the pro and cons of Spark, Serverless, event-driven and distributed systems, and make decisions on what to use. You are hands-on, collaborate and lead a growing team to develop and move from proof-of-concepts to production-grade solutions without being surprised by operational demands and SLAs. You are experienced in the good practices of software development including Continuous Integration and Delivery workflows. Most of all, you are passionate about your work while not dogmatic about specific technologies. You love working in cross-functional teams and you enjoy learning from and teaching others. Your colleagues would describe you as highly professional as well as fun to work with. About Us: Brady plc is the largest European-headquartered provider of trading and risk management software to the global commodity, recycling and energy markets. Brady combines fully integrated and complete solutions supporting the entire commodity trading operation, from capture of financial and physical trading, through risk management, handling of physical operations, back office financials and treasury settlement, for energy, refined and unrefined metals, scrap and secondary metals, soft commodities and agricultural products. We are revolutionising an industry that has not significantly changed in decades by employing Big Data, Data Science, and Cloud Computing. Imaging a world where energy consumption is data driven from end-to-end, where customers actually benefit from smart meters and where renewables are used more efficiently. Join the Brady team today!
This job was originally posted as www.jobsite.co.uk/job/959232221