Senior Data Engineer

at  Compliance Risks

ABOUT US:

Compliance & Risks provides global companies with the tools, insights, and expertise to build safe, sustainable products. With two decades of experience, we help monitor, assess, and prove compliance, protecting your brand and driving growth in an evolving regulatory landscape.
The company serves over 320+ global enterprise customers including: GE, Google, Nike, Amazon, Bose, Tesla, Vaillant, Unisys, Samsung and Fujitsu.

SKILLS AND EXPERIENCE

• Masters degree in computer science, IT or other highly technical, scientific discipline
• 7+ years experience in a data engineering role
• Knowledge of database standards, data models and data structures
• Experience with cloud computing and cloud services connected to the data platforms such as AWS and Azure
• Have extensive experience with data security standards and implementation
• Strong proficiency in Python and SQL, with experience in Java, and a solid understanding of NoSQL data languages and systems
• Strong experience in data analysis and analytical data systems design and implementation
• A proactive approach to spotting problems, areas for improvement, and performance bottlenecks
• Previous success in technical engineering and supporting a complex SaaS solution
• Desirable knowledge of object-relational mapping programming technique, also Hibernate and JPA in Java

OBJECTIVE OF THE ROLE:

• Planning, implementation and maintenance of complex data storage systems, both relational and non-relational
• Participate in a follow-the-sun support model ensuring the reliability and uptimes of the C2P platform.
• Partner with engineering and product teams to build and improve data services for the product needs, as well as for internal and external reporting
• Participate in system design consulting, platform management, and capacity planning
• Create sustainable data systems and services through automation and uplifts
• Maintaining data privacy and consistency

DAILY AND MONTHLY RESPONSIBILITIES

• Analyze user and product requirements to design and develop robust data systems and pipelines, ensuring seamless integration from the backend infrastructure to the front-facing applications
• Collect and analyze metrics from the data layer, as well as software logs and performance indicators, to support optimization efforts and troubleshoot system issues
• Administer and enforce data access security protocols and manage user permissions to ensure compliance and protect sensitive information.
• Design, implement, maintain, monitor, and continuously improve data storage solutions, ensuring high availability (HA), reliable recovery mechanisms, and optimization of the analytical stack for the entire data team
• Develop programs and scripts to automate processes, prioritizing automation as the preferred approach for implementing new workflows and optimizing efficiency
• Development and maintenance of data layer documentation
• Write DR (disaster recovery) documentation for the data layer and test it periodically
• Provide proactive support to developers in resolving performance issues related to software and addressing potential challenges in production systems