Data Engineer

at  ITDS Business Consultants

JOIN US, AND DRIVE API DEVELOPMENT WITH STATE-OF-THE-ART TECHNOLOGY!

Krakow-based opportunity with the possibility to work 100% remotely!
As an Data Engineer, you will be working for our client, a major financial institution focused on modernizing their data infrastructure. The project involves creating a data pipeline to unify and streamline their existing metrics and data models, followed by developing an API layer to expose this unified data to various platforms. You will be part of a collaborative team, working with other developers to integrate isolated models and build the necessary pipelines, with opportunities to contribute to data quality rules and potentially support Power BI dashboard development.

YOUR MAIN RESPONSIBILITIES:

• Developing and implementing data pipelines to unify and transform data models
• Designing and building an API layer for data exposure to multiple platforms
• Integrating data from external sources into the unified data model
• Collaborating with team members to understand and integrate isolated data models
• Proposing and implementing data quality rules for transformation processes
• Assisting in the creation of Power BI dashboards, if project scope allows
• Participating in daily team calls and contributing to various deliverables
• Engaging with other team members and taking responsibility for individual tasks
• Utilizing Databricks and Pyspark for pipeline development
• Applying front-end API design principles in API development

YOU’RE IDEAL FOR THIS ROLE IF YOU HAVE:

• Experience with Qlik Sense
• Strong experience with Pyspark and Databricks
• Proficiency in API design and development
• Experience in building and maintaining data pipelines
• Knowledge of integrating and transforming data from various sources
• Experience with data modeling and unification
• Good understanding of data quality management
• Ability to collaborate effectively within a team
• Experience with data visualization tools such as Power BI
• Familiarity with GCP and BigQuery
• Fluent English