Spark Developer

at  ELLIOTT MOSS CONSULTING PTE LTD

This role requires a hands-on approach to coding, often in a pair programming environment, and demands a deep understanding of model implementation, data structures, and financial products.

ESSENTIAL SKILLS & PREREQUISITES:

• Degree in Computer Science, Engineering, Mathematics, or a related field, or a Bachelor’s/Master’s degree with 4 years of relevant experience.
• 3-4 years of hands-on development experience with Spark, ScalaSpark, and distributed computing.
• 3-4 years of experience in designing and developing applications using Python.
• 3-4 years of experience working with Hadoop platforms, including Hive, HDFS, and Spark.
• 3-4 years of experience with Unix shell scripting for automation and data processing.
• 3-4 years of experience with SQL for database querying and management.
• 2-3 years of experience with Spark programming, including development and optimization.
• Strong understanding of microservices architecture and cloud environments (knowledge is an advantage).
• Familiarity with Java and Scala (knowledge is an advantage).

DESIRABLE SKILLS:

• Experience with microservices architecture and cloud technologies.
• Knowledge of Java and Scala for diverse development needs.

QUALIFICATIONS:

• Bachelor’s or Master’s degree in Computer Science, Engineering, Mathematics, or a related field.
• 6+ years of relevant experience in application development with a focus on financial risk and finance models.

• Design, develop, and implement complex applications that have a transformative impact on enterprise operations.
• Utilize the latest tools and techniques for high-quality code development and implementation.
• Engage in hands-on coding, often working in a pair programming setup to enhance code quality and efficiency.
• Collaborate with cross-functional teams to build robust and scalable solutions.
• Demonstrate a strong understanding of model implementation, data manipulation, distributed processing, application development, and automation.
• Develop and maintain applications related to consumer financial products, risk, and finance models.
• Apply expertise in Spark, ScalaSpark, and distributed computing to meet business requirements.
• Leverage your knowledge of financial products and data systems to support model implementation and process optimization.