IT Developer - Expert for KYC

at  Skillspark AB

STARTASAP

DURATION> 12 months
Industry: Banking
Location: Warsaw (1 day a week work from Warsaw office)
Project language: English
Rate: up to 170 PLN/h
Start: ASAP
Contract period: 12 months + possible extension
Assignment type: B2B

REQUIREMENTS:

• Extensive experience in data architecture, with a focus on big data technologies, data lakes, and data warehouses.
• Proficiency in relational databases, specifically MSSQL, and experience with Cloudera (version 6 or preferably 7), Hive, Golden Data and Python programming language.
• Hands-on experience with any of the big data frameworks and tools such as Hadoop, Spark, AWS EMR, Snowflake or DataBricks.
• Deep understanding of managing and processing both structured and semi-structured data.
• Familiarity with data governance, security, and compliance in the financial services industry.
• Strong problem-solving skills with a focus on scalability and performance optimization.
• Excellent communication and collaboration skills to work with cross-functional teams.
• Ability to work in a distributed team in the agile methodology with SAFE framework.
  Bachelor’s degree in Computer Science, Information Technology, or a related field; a master’s degree is a plus.

• Architect and implement scalable, high-performance data solutions, including data lakes, data warehouses, and big data platforms.
• Design and optimize data pipelines for ETL processes, ensuring efficient data ingestion, processing, and storage.
• Lead the integration and management of structured and semi-structured data from various sources into scalable systems.
• Collaborate with data engineers, analysts, and stakeholders to ensure alignment with business objectives and data governance standards. Work closely with cross-functional teams to ensure that data architecture aligns with business needs and regulatory requirements.
• Drive the adoption of modern data management practices, including the use of big data technologies (e.g. Spark, DataBricks, Hadoop) and cloud platform AWS.
• Develop strategies for data retention, archiving, and security that comply with industry regulations and best practices.
• Utilize your knowledge of Cloudera (version 6 or preferably 7), Hive, Golden Data, CCM, Drools Engine LCI to design and implement robust data solutions.
• Stay updated with the latest advancements in big data and cloud technologies, and recommend innovations to improve existing data systems.