Spark Developer/ FullStack Engineer

at  Skillspark AB

REQUIREMENTS:

• A university graduate with a degree in computer science, IT or a related discipline. Fluent oral English.
• Solid Spark development experience. Rich and hands on experience in developing distributed and high performance applications with Spark, dealing with huge data size and volume.
• Rich and hands on experience in IT system solution design and development, a sound appreciation of the full development life cycle, including release management, experience of work in Agile methodology.
• Solid skill set, knowledge and development experience in Java or Scala. Familiar operation of Unix/Linux, Git and Maven is essential.
• Solid knowledge of software testing, hands on experience of delivering different types of testing automation with proper technology such as Junit, Cucumber, Karate, Rest Assured , Pact.
• Hands on DevOps tooling experience such as Jenkins, Ansible.
• Strong problem solving skills, able to work independently and under pressure against multiple deadlines. Sound communication and presentation skills.
• Enthusiastic and self-motivated with excellent time management skills and strong initiative to work as part of a team. Able to work with business and technology clients to identify/define the business requirements and suggest practical solutions.
• Experience in using public cloud such as GCP.
• Knowledge of Financial Risk management in banking or financial industry.
• Knowledge specific to the Traded Risk domain.
• Knowledge of HSBC policies, processes and procedures is an advantage.
• Experience of BI solution development.
• Experience on streaming solution build and distributed computation solution build.
• Solid knowledge of Spring framework: Spring boot, Spring Batch, Spring Cloud, Spring Cloud Gateway, Eureka
• Apache Airflow.
• Experience of RPC development such as using gRPC is a plus.
• Experience in OLAP solution development, solid knowledge of OLAP data modeling and using OLAP data warehouse such as Clickhouse, Druid and Pinot.
• Solid knowledge of data Lakehouse development such as using query engine Dremio, Trino etc. Table format Iceberg, Delta or Hudi.
• Experience of Apache Beam, Apache Flink, Apache Samza, Hazelcast, Dataflow.
• MDX, XMLA, Flink, Redis, Apache Beam.
• Container technologies (Docker, Kubernetes).
• Scrum master knowledge or certified, or PMP certified.
• FRM or CFA certified.

• Analyze, design, develop, test, deploy and support IT solution to achieve business goal.
• Deliver a data process and calculation service that integrates with analytics library from the Risk Analytics team.
• Adopt DevOps and Agile principles, Work in DevOps Pracise. Automating the founctional and non-functional test. Build CICD pipeline and environment. Maintain the environment and investigate infrastructure problem which affecting building service. Build observability into it.
• Work closely with business, BA, vendor and up/down stream IT teams on requirement analysis and solution design
• Work closely with Risk Analytics team on analytics library design and integration
• Ensure test-driven development and close collaboration with team members in London, Hongkong and China(Guangzhou),
• Support the platform: incident resolution, monitoring, problem management,
• Investigate, research and provide professional insight for delivering technology solutions and overcome blockers.
• Maintain IT systems in production. Provide production support.
• Maintain good quality of the delivery for functional and non-functional.