KEY SKILLS/EXPERIENCE:

• Working experience and strong knowledge in Databricks.Knowledge in Cloud Computing – AWS preferably

KNOWLEDGE IN DATA WAREHOUSING (SCD)

• Knowledge in programming and shell scripting eg. Core/Python/Scala/Java
• Knowledge in SQL
• Knowledge with Github and Jenkins;
• Knowledge on change data capture in a big data ecosystem;
• Knowledge building real time or batch ingestion and transformation pipelines;

THE FOLLOWING QUALIFICATIONS WOULD BE ADVANTAGEOUS:

• Education level – Degree in Computer Science, Information Systems or related field
• Databricks Associate certification and AWS certification would be advantageous
• Understanding of Financial Services Industry could be advantageous
  

  LI-AR

KEY RESPONSIBILITIES INCLUDE:

• Designing, developing and implementing solutions to customers organisational problems;
• Providing high quality service delivery on engagements;
• Designing and developing data reconciliation & metadata driven data processing frameworks;

ADDITIONAL SKILLS/RESPONSIBILITIES OF THIS ROLE:

• Knowledge on supporting a production service in a DevOps friendly environment;
• Knowledge on working in Agile/Scrum teams;
• Knowledge on API and cloud-native architecture;
• Knowledge on with ‘container’ technology (e.g. Docker, Kubernetes);
• Knowledge on wrangling data using library such as Pandas, Scikit-learn or Numpy;
• Knowledge on using notebook such as Jupyter or Polyglot;
• Knowledge on test-driven development, test automation & continuous delivery