Senior Data Engineer - emagine

at  Skillspark AB

REQUIREMENTS:

• 7+ years relevant experience
• Honours Degree or Postgraduate Diploma (NFQ Level 8 or equivalent) in a Numerate Discipline (e.g. Computer Science, Data Analytics, Engineering, Economics etc.)
• Experience in building and maintaining database systems
• Experience in data management best practices including demonstrated experience with data profiling, sourcing, and cleansing routines utilising typical data quality functions involving standardisation, transformation, rationalisation, linking and matching
• Fluency in using SQL and T-SQL and programming languages preferably Python, C#
• Writing stored procedures
• Adept at finding warehousing solutions, and using ETL (Extract, Transfer, Load) tools e.g. ADF, SSIS, and understanding basic machine learning and algorithms
• Experience working on different type of databases, On-Prem SQL Server , Azure SQL DB, Azure Synapse SQL Pool
• Building data models for PowerBI, SSRS and Exc
• Experience using Azure DevOps, Github
• Working knowledge of Gen 2 Azure Data Lake, Storage Account, Blobs, Azure Function, Logic App
• Good communication and collaboration skills and ability to work with a range of stakeholders, from data analysts to business SMEs
• Creating and updating reusable pipelines and warehouse objects
• Ability to translate requirement, solution document into actionable/deliverable technical steps

• Building and maintaining database systems. Product support process
• Developing and updating ETL processes/pipelines, using various cloud and on-prem ETL tools
• Writing and updating SQL objects, including stored procedures, tables, views
• Creating and updating reports using various BI reporting tools
• Creating, updating and maintaining star schema
• Creating and maintaining solution to manage master/reference data
• Creating and updating reusable pipelines and warehouse objects
• Create, update and checkin/checkout code using various DevOps tool
• Creation of unit test documents