We welcome applications from Candidates seeking both Permanent employment or Contract roles.
WHISHWORKS is a global IT services and consulting company, specialising in Big Data / Real-time event / Data Streaming design, solutioning and systems integration. Over the years we have helped hundreds of businesses access, control and monetise their data, becoming the partner of choice for data-driven organisations.Why WHISHWORKS
At WHISHWORKS, we offer our employees a world of potential. We invest in our people to help them develop and achieve their goals. We encourage them to roll up their sleeves, dive in and make the most out of the opportunities bound to come their way.Role Summary
As a Big Data Architect, you will be implementing several projects for our clients and become a go to person. You would ideally be a specialist in Data and Cloud technologies with excellent consultative skills. You would be working with various data technologies from companies like Azure, AWS, Kafka, Spark, Hadoop platforms etc.Primary Responsibility
Desired Skills, Attributes & Experience
- Full lifecycle implementation from requirements analysis, platform selection and setup, technical architecture design, application design and development, testing, and deployment.
- Provide consultative recommendations to clients to solve their Big Data challenges.
- Work as an individual contributor and or team player based on the projects
- A minimum of 10+ years' experience in Data systems and solution consulting.
- A minimum of 5 years' experience in Cloud, Data Management Platforms and Streaming related technologies
- A minimum of 2 years' experience as Data Architect.
The ideal candidate should have 'Platform Consulting & Implementation Experience' and 'Solution Consulting and Implementation Experience'.Skills RequiredMust Have
Experience in Kafka / Confluent installation and administration and deep knowledge of Kafka internals
Experience of Kubernetes and Confluent Operator
Experience of physical data modelling and serialisation formats such as Apache Avro
Strong experience in implementing software solutions in enterprise Linux or Unix environments
Experience in Data Ingestion tools, Streaming, Spark, Hadoop etc.
Hands-on experience in setting up and running Azure and AWS Data platforms, Hadoop, Streaming clusters etc.Should Have
The ideal candidate should have 'Platform Consulting & Implementation Experience' and 'Solution Consulting and Implementation Experience'.
Platform Consulting & Implementation Experience
Extensive background in Systems Architecture, Clustering & Distributed Systems, Programming, Security, Networking & Load Balancing, Monitoring, Scripting and Automation gained in large mission critical infrastructures.
Experience on cloud platforms like AWS and Azure, hands-on working knowledge on cloud native data components.
Experience with integrating various security solutions such as LDAP, Kerberos, SPNego or system / installation management tools into the overall solution.
Strong understanding of OS, network configuration, devices, protocols, and performance optimisation.
Understanding of configuration management systems, devops and automation (e.g. Ansible, Puppet, Chef).
Solution Consulting & Implementation Experience
Demonstrable experience in gathering and understanding customer's business requirements, solutioning and implementing them.
Strong programming experience in any programming languages with design patterns, algorithms, ETL/ELT pipeline design, and data analytics.
In depth work experience on Messaging, Data Ingestion, Stream and Batch Processing etc.
Experience in one or more visualisation tools like Qlikview, Tableau etc.Nice to Have
Azure, AWS, Hortonworks, MapR or Cloudera certifications.
Experience in installation / upgrade / management of multi node Hadoop clusters using distributions such as Hortonworks, Cloudera, or MapR.
Experience in securing Hadoop clusters using technologies such as Ranger, Sentry, data encryption over wire or rest, Kerberos, etc.
Experience in managing Hadoop clusters and performing daily activities to have a cluster with minimal downtime.
Experience in Scala, Spark implementation projects.Position Requirements
Our Commitment to You
- Ability to travel up to 50% of the time
- Bachelors or master's degree in computer technology
You'll benefit from our network of global communities and collaborative culture and can develop valuable industry-specific expertise. The scale of our capabilities, client engagements and the unique way we innovate, operate and deliver value, will provide you the support to deepen your dynamic leadership skills.