Senior Big Data Developer

at  SymphonyAI

Introduction:
JOIN US! We are seeking a skilled Senior Big Data Developer to join our London team and play an integral role in shaping the data infrastructure required for actionable investment insights and high-performance trading decisions.
Job Description:
The Senior Big Data Developer will be responsible for crafting, deploying, and maintaining the data pipeline architecture that is central to our analytics and trading platforms. The ideal candidate will bridge the gap between data science and data management, ensuring our data is accurate, accessible, and efficiently processed for various trading and investing applications.

• Develop and maintain scalable and reliable data pipelines that can ingest and process large volumes of data with high velocity and variety.
• Work closely with data scientists, analysts, and other stakeholders to understand data requirements and implement systems for data integration, cleansing, and analytics.
• Build and optimize data models, ETL processes, and storage solutions (data lakes, data warehouses).
• Ensure data quality and compliance with data governance and security policies.
• Monitor performance and advise on necessary infrastructure changes.
• Define data retention policies and implement disaster recovery systems.
• Troubleshoot and resolve any issues in the data pipeline.
• Stay abreast of industry trends and best practices in data engineering and introduce new technology and tools where applicable.