Data Engineer (f/m/d)

at  AWIN

EDUCATION & EXPERIENCE

• Bachelor degree or higher in data science, data engineering, business intelligence, business administration or similar education with focus on data engineering / intelligence / analytics is preferred
• 2+ years working experience as data warehouse developer, data engineer with python or similar
• Hands on with full Microsoft Azure data engineering pipelines
• Excellent knowledge in database and dimensional modelling technologies.
• Excellent knowledge of Azure Data Factory, Azure Data Bricks, Python (NumPy, Pandas), ADLS, Azure Event Hub, Azure SQL DB
• Excellent knowledge of SQL, T-SQL, Python and PySpark
• Have working knowledge of scrum and Agile practices.
• Proven communication and analysis skills
• Ideally, any of: experience working in a big data environment, AI/ML framework/libraries (MLlib, MLops, Scikit-learn, TensorFlow, Matplotlib), Spark and JSON is preferred

SKILLS & CORE COMPETENCIES

• Ability to create complex ETL Python/PySpark functions to support application development
• Very strong analytical skills to translate business needs into actions with a proactive approach to tasks and challenges, delivering projects on time and budget
• Strong mathematical skills, ability to learn concept and apply them to problems.
• Create a mind-set to bring new ideas and push the data warehouse development
• Willing to change, learn, and start initiatives
• Ability to face existing challenges self-reliant with the courage to make autonomous decisions if needed
• Very strong communication and interaction skills
• Very strong project and process management competency, keen to deliver your project on time/budget without compromising on quality and results
• Team player, willing to improve yourself

PURPOSE OF POSITION

Data sits at the heart of the company. This role is to ensure that Awin is able to leverage the data it has access to across the group and build out reporting to ensure we are able to make better commercial decisions and provide best-in-class campaign management to support client facing departments.
As a Data Engineer, your responsibility is collecting data from a different source, sanitizing, cleansing, transforming and consolidating these collected data and make them available for further analysis and/or publish them as a report.
You understand data, business and technical requirement. You write clean and high-quality code that is easy to understand and maintain. You clearly understand the various methodology of data extraction, transformation and storage and successfully applying your experience and knowledge of scripting, SQL, and conceptual OLTP and/or OLAP database.
Within the role, you will be responsible for smooth running of data warehouse day to day operation and be working with a global team of data engineer, analyst and reporting team amongst other big data engineer within the organization.

KEY TASKS & ACCOUNTABILITIES

• Write clean, elegant and maintainable code with data warehousing best practices and modelling techniques (Kimball, Star Schema etc.)
• Troubleshoot data transformation error by debugging and formulate plan to fix it.
• Presents clearly and confidently findings of bugs and system improvement to stakeholders.
• Create new Azure pipelines, data bricks notebook to add data points to existing and new source.
• Add new datapoint to existing AAS cube.
• Create new reports and update existing report definition
• Find new innovative way to improve performance of existing process and transformation function.
• Accountable for quality and accuracy of data and report.