YEARS OF EXPERIENCE

5+ years

WHAT SKILLS YOU BRING

• 5+ years of experience in large-scale data engineering, including at least 4 years in leadership or management roles
• Proficient coding background in Java, Python, or Scala with strong software engineering principles
• Hands-on expertise in the big-data ecosystem: Kafka, Spark, Hadoop, Iceberg, Airflow, and modern data modeling
• Experience building both batch and real-time pipelines for production use cases
• Solid knowledge of relational (DB2) and non-relational (MongoDB) databases and data formats (Parquet, CSV, JSON, XML)
• Proven track record with enterprise big-data platforms such as Databricks, Elasticsearch, or Snowflake
• Excellent communicator, capable of translating complex technical concepts to non-technical stakeholders

WHY THIS ROLE MATTERS

As a Senior Data Engineer on our client’s Counterparty Data and Regulatory Technology (CDRT) team, you’ll spearhead strategic initiatives that elevate our client’s data platform’s scale, reliability, and innovation. Your work will drive critical data ingestion and entity resolution capabilities, directly impacting risk management, regulatory compliance, and counterparty insights firmwide.

WHAT YOU WILL DO

• Collaborate in a cross-functional Agile squad to design, develop, and enhance our client’s data ingestion and entity resolution services
• Lead technical design for our client’s application, data, and infrastructure architecture across structured and unstructured datasets
• Build efficient storage, search, and retrieval pipelines using batch and real-time processing frameworks
• Prototype user-driven solutions rapidly to evaluate architectural approaches and technology options
• Develop and maintain data pipelines leveraging Python, Java, or Scala and a mix of relational and NoSQL databases
• Deploy, monitor, and optimize big-data products such as Databricks, Elasticsearch, and Snowflake
• Mentor and guide junior engineers, fostering best practices around coding standards, testing, and performance tuning