Data Engineer

Recruiter
re:infer
Location
Whitechapel
Posted
12 Oct 2018
Closes
17 Oct 2018
Contract Type
Permanent
Hours
Full Time
*What you’ll be doing*

As a Data Engineer you'll work closely with machine learning engineers and data scientists, designing and building new data pipelines and processes to enable re:infer to expand its natural language processing platform to as many sources of data as possible. With new kinds of data streams coming in all the time, you’ll be working all the way from the initial manual processing and upload to the fully automated, distributed, productionised pipeline.

We’re looking for someone who’s really into programming, who can learn quickly and adapt to changing requirements. Beyond that you need to be kind, courteous, motivated, self-starting, honest and responsible.

*Skills and experience with (sorted from “important” to “nice-to-have”)*
Python data processing
Linux
Interfacing with third-party REST APIs
Understanding of different database systems
Pandas, numpy, scipy, sklearn
Git

*Our Stack*
The backend is a mixture of Python and Rust and consists of many containerized stateless microservices (and a few stateful ones), some interactive, some batch, with many running heavy numerical loads. Everything gets deployed on Kubernetes in Google Cloud Platform. We use RethinkDB and Elasticsearch for storage and indexing.

*The business*
re:infer makes human conversations understood and actionable to machines. We allow our (often non-technical) users to create, manage and deploy state-of-the-art machine learning algorithms against high volume streams of conversational data. Our mission is to make all natural language communication structured, measurable and easily actionable.

re:infer is a B2B SaaS machine learning and analytics platform controlled and monitored via a web UI. We are an early stage startup with significant funding and growing very fast. It is an opportunity to make a major impact at an early stage, to tackle big problems and work towards artificial intelligence with a true grasp of human language.

re:infer’s offices are at Mindspace Aldgate, in the heart of East London.


*The team*
re:infer was founded by Machine Learning researchers, engineers and entrepreneurs from UCL and Google. We’re a small team of technologists (~ 10 people) motivated by solving the very hard problem of getting machines to understand conversations.

We work in two-week sprints following the best bits of the Agile approach to software development. Our employees benefit from a relaxed, social atmosphere in which they’re free to make use of our open-plan office to discuss ideas, or put their headphones in and find a quiet corner as and when they require. We support flexible working hours and have a generous holiday policy and company pension. Everyone gets their own top-spec laptop and whatever office hardware works for them.

Similar jobs

Similar jobs