Data Engineer (Spark Developer)

at  LYNEER CORP SINGAPORE PTE LTD

THE OPPORTUNITY

Leveraging the latest technology to develop mission critical applications from scratch. design, develop, test and deploy new applications as part of the strategic transformation programme, using Agile, cloud technologies, microservices and Big Data.

Key Responsibilities

• Creating complex, enterprise-transforming applications on diverse, high energy teams
• Working with the latest tools and techniques
• Hands-on coding, usually in a pair programming environment
• Working in highly collaborative teams and building quality code
• The candidate must exhibit a good understanding of model implementation, data structures, data manipulation, distributed processing, application development, and automation.
• The candidate must have a good understanding of consumer financial products, data systems and data environments, and processes that are necessary for the implementation of Risk and Finance models

ESSENTIAL SKILLS & PREREQUISITES

• Degree in computer science or a numerate subject (e.g. engineering, sciences, or mathematics) or Bachelor’s/Master degree with 6 years of experience
• Hand-on Development experience with Spark, ScalaSpark and Distributed computing.
• Development and implementation experience of applications for 4-6 years.
• 4 to 6 years’experience designing and developing in Python.
• 4 to 6 years’ experience in Hadoop Platform (Hive, HDFS and Spark)
• 3 to 5 years’experience with Unix shell scripting
• 3 to 5 years’experience with SQL
• 2 to 3 years’ experience with Spark programming.
• Knowledge of micro-services architecture and cloud will be added advantage.
• Knowledge of Java and Scala will be added advantage

• Creating complex, enterprise-transforming applications on diverse, high energy teams
• Working with the latest tools and techniques
• Hands-on coding, usually in a pair programming environment
• Working in highly collaborative teams and building quality code
• The candidate must exhibit a good understanding of model implementation, data structures, data manipulation, distributed processing, application development, and automation.
• The candidate must have a good understanding of consumer financial products, data systems and data environments, and processes that are necessary for the implementation of Risk and Finance model