Data Middleware Software Engineer at OKX

Hong Kong Island, Hong Kong, China -

Full Time

Start Date

Immediate

Expiry Date

01 Feb, 26

Salary

0.0

Posted On

03 Nov, 25

Experience

10 year(s) or above

Remote Job

Yes

Telecommute

Yes

Sponsor Visa

Skills

Java, Middleware, Data Synchronization, SQL Optimization, Distributed Systems, ETL, CDC, Performance Tuning, Data Monitoring, High Availability, Data Consistency, Open-Source Technologies, System Analysis, Problem Solving, Architecture Design, Technical Challenges

Industry

IT Services and IT Consulting

Description

Who We Are At OKX, we believe that the future will be reshaped by crypto, and ultimately contribute to every individual's freedom. OKX is a leading crypto exchange, and the developer of OKX Wallet, giving millions access to crypto trading and decentralized crypto applications (dApps). OKX is also a trusted brand by hundreds of large institutions seeking access to crypto markets. We are safe and reliable, backed by our Proof of Reserves. Across our multiple offices globally, we are united by our core principles: We Before Me, Do the Right Thing, and Get Things Done. These shared values drive our culture, shape our processes, and foster a friendly, rewarding, and diverse environment for every OK-er. OKX is part of OKG, a group that brings the value of Blockchain to users around the world, through our leading products OKX, OKX Wallet, OKLink and more. Responsibilities: Responsible for the design and development of the company's database middleware. This includes but is not limited to the design and implementation of Redis, Mybatis, ES, and Lindorm SDK, as well as meeting the core technical requirements in scenarios with extremely high transaction traffic and low latency. Design high-availability and high-performance database middleware and data access layer architectures, optimize SQL performance and distributed transaction processing. Build a data monitoring system, design integration solutions and data consistency guarantee mechanisms. Be responsible for the overall architecture design, development and evolution roadmap planning of the company's next-generation data synchronization platform, aiming to create a core foundation for high-throughput, low-latency and highly available real-time data transmission. Lead the core module development of the data synchronization middleware, including but not limited to real-time capture of heterogeneous data sources (CDC), data transformation (ETL), transmission protocol optimization, and distributed task scheduling. Deeply study open-source data synchronization technologies such as Canal, FlinkCDC, and SeaTunnel, analyze their underlying principles (such as Binlog parsing, snapshot mechanisms, and breakpoint resumption), and conduct in-depth customized development and performance optimization. Benchmark against industry-leading commercial products (such as Alibaba Cloud DTS), design and implement enterprise-level features such as dynamic topology management, data consistency verification, fine-grained monitoring and alerting, and self-healing capabilities for faults. Solve complex technical challenges such as extreme performance bottlenecks, network jitter, and data consistency in massive data synchronization scenarios, and develop universal solutions. Build an observability system for the data synchronization platform, providing end-to-end data link tracking, latency analysis, and throughput monitoring to enhance the stability and maintainability of the system. Qualifications: Bachelor's degree or above, major in computer science, with over 8 years of R&D experience in middleware or data platform-related fields. Proficient in Java, with solid programming skills, excellent coding standards, and performance tuning capabilities. Deeply understand the architecture and implementation principles of at least one open-source data synchronization middleware (Canal, FlinkCDC, SeaTunnel, Redis Replicator), and those with relevant secondary development or source code contribution experience are preferred. Familiar with the internal mechanisms of at least one mainstream database (MySQL, PostgreSQL, Elastic Search, Redis), and have in-depth understanding of Binlog/Redo Log/Logical Replication/Redis Replicator Buffer. Familiar with the source code of common database middleware (Mybatis, Lettuce, Jedis, Rest ES, ShardingJDBC, MySQL Connector Java). Have a profound understanding of core theories of distributed systems, including but not limited to consensus protocols (Raft/Paxos), distributed transactions, high availability design, etc. Possess excellent system analysis and problem-solving capabilities, and be able to independently undertake the architecture design and technical攻关 of complex systems. Those with experience as a core member of the data infrastructure or middleware team in large-scale Internet companies are preferred. Perks & Benefits Competitive total compensation package L&D programs and Education subsidy for employees' growth and development Various team building programs and company events Wellness and meal allowances Comprehensive healthcare schemes for employees and dependants More that we love to tell you along the process! Information collected and processed as part of the recruitment process of any job application you choose to submit is subject to OKX's Candidate Privacy Notice.

Responsibilities

Design and develop the company's database middleware, focusing on high-availability and high-performance architectures. Lead the development of the data synchronization platform and solve complex technical challenges in data synchronization scenarios.