Senior Data Engineer

at  NIELSENIQ

Company Description
R24_0000956|CA
At NIQ, we deliver the most complete and clear understanding of consumer buying behavior that reveals new pathways to growth. We are looking to add a Senior Data Engineer to our Activate team.
The NIQ Activate team serves dozens of retailers and brands worldwide using cutting-edge Big Data, real-time analytics, and data science automation. Our solution is disrupting existing data & media monetization models by enabling retailers to remain in control of their revenue.

QUALIFICATIONS

• 5+ years of experience working as a data engineer in ETL and data integration.
• 5+ years of experience in client facing consultation role, project management expertise, managing customer expectations and deadlines and excellent communication skills.
• Strong Python – Pyspark development experience.
• Strong SQL with experience in querying large, complex data sets.
• Databricks, Spark, Airflow, and Scala development experience.
• Experience working with retailer and supplier analytics data.
• Experience with Cloud platforms – Azure strongly preferred.
• Experience in data integration design, development and maintenance, data lakes/hubs.
• Result-driven, pragmatic, and innovative.
• Experience with developing REST APIs and microservices.
• Computer Science, Engineering, Information Systems, Statistics, Math degree (or equivalent combination of skill and experience).
• Experience with SingleStore, Snowflake, BI tools i.e. PowerBI – nice to have.
  Additional Information

Job Description
As a Senior Data Engineer, you’ll be part of a team of smart, highly skilled engineers who are proud to partner with some of the world’s leading retailers on challenging, cutting-edge, data driven solutions - all powered by our exceptional technology and people.
Our core technologies currently include Python, Databricks and Azure, and we continue to adopt the best of breed in modern data stack technologies. Our team is co-located and agile, with a central hub in Toronto.

Responsibilities:

• Responsible for leading data onboarding workstreams with new customers / pilots / POCs.
• Work directly with customers’ data teams on data interfaces, specifications and integration projects.
• Design, implement and maintain performance of reliable data pipelines and interfaces that feed various analytics applications.
• Design, develop, and maintain ETL from various data streams via multiple consumption methods (e.g. Blob, Kafka, SFTP, SQL connectors, REST API).
• Design, development, and implementation of new and existing data processing solutions; enabling teams to be more efficient and effective in analyzing data and getting to insights faster.
• Create, implement, and maintain data transformation and data validation processes.
• Perform data validation activities, normalize and explore datasets, investigate and solve data related problems.
• Support data architecture efforts in support of key analytics innovations that involve multiple internal and/or external (client) stakeholders.