Big Data Administrator

at  Discovery Ltd

Business Unit: Discovery Health
Function: Information Technology
Date: 4 Nov 2024
Discovery – Health Systems (DHS)
Big Data Administrator
About Discovery
Discovery’s core purpose is to make people healthier and to enhance and protect their lives. We seek out and invest in exceptional individuals who understand and support our core purpose, and whose own values align with those of Discovery. Our fast-paced and dynamic environment enables smart, selfdriven people to be their best. As global thought leaders, Discovery is passionate about innovating in order to not only achieve financial success, but to ignite positive and meaningful change within our society.
About Discovery Health Systems (DHS)
The Discovery Health Systems (DHS) is a world class software development house that enables the Discovery Health Business to use digital transformation as a competitive advantage. It focuses on rapid quality software delivery. Innovation and excellence are key attributes to all our initiatives. The skills and expertise in the team allows a diverse product development on all strategic, tactical and operational changes. Our environment is fast-paced and demands energy, drive, enthusiasm, ownership and creativity, but it rewards with an extremely fulfilling and stimulating environment that actively supports career growth and development.
Key Purpose
To join our Enterprise Architecture team (System Architects, Enterprise Architects, Developers) with the responsibility of understanding the overall business needs and the requirements. The primary responsibility of this role is to have deep understanding and be able to perform the admin tasks for the Big Data environment.

Areas of responsibility may include but not limited to

• Be able to perform installations from scratch
• Handle all key server integration and HA responsibilities
• Setup the Kerberos dependencies and necessary configuration
• Create and manage users / groups
• Manage the security roles – AD as well as Sentry / Ranger and OS
• Understand all admin modules, ingestion pipeline as well as monitoring requirements
• Be able to perform troubleshooting e.g. identifying unhealthy / problematic modules in the context of an issue / problem resolution
• Handle partitioning and indexing requirements with the objective not to compromise performance
• Have excellent in depth OS knowledge and handle any OS level scripting requirements
• Provide the necessary OS training / knowledge transfer to the Junior Administrators
• Mange the TCP proxy and any firewall port requirements
• Plan and provision new hardware as required.]
• Execute the BigData hybrid strategy e.g. seamless on premise and in the cloud cluster integration

Personal Attributes and Skills

• Technology savvy person with real hunger for acquiring technology knowledge
• Ability and willingness to do research and do remote courses
• Fast learner
• Learning is regarded as a hobby
• Really driven individual
• Ability to work under stress
• Self-starter

Education and Experience

• BSc Computer Science or equivalent 3-year IT qualification
• 2 years’ experience in a Chief Technology Office working on the Big Data environment
• Cloudera|Hortonworks|Linux (RedHat) Certification - advantageous
• Understanding of and experience in distributed architecture working with Python, JVM and multithreading
• Good experience in partitioning and sharding
• Good experience in Datacenter architecture and processes working on racks, servers and wiring
• Good understanding of network – topology, VLANs, switches, routers including firewalls (Kerberos, PKI)
• Experience working with AD forest and LDAP including strong operating systems such as Linux (RedHat)
• A good grasp of Cloud infrastructure (preferably AWS) architecture, provisioning and operating
• Experience and knowledge of tools such as HBase, HDFS, Spark, Map Reduce, Zookeeper, YARN, Kafka, NiFi
• Strong experience in TCP, UDP, multicast
• Entry level knowledge of containers (Kubernetes and Docker)

Please refer the Job description for details