Senior Data Engineer (Apache Airflow, DBT/Snowpark/PySpark, Python and SQL, at NielsenIQ

Pune City, maharashtra, India -

Full Time

Start Date

Immediate

Expiry Date

20 Apr, 26

Salary

0.0

Posted On

20 Jan, 26

Experience

5 year(s) or above

Remote Job

Yes

Telecommute

Yes

Sponsor Visa

Skills

Apache Airflow, DBT, Snowpark, PySpark, Python, SQL, Stored Procedures, Data Modeling, AWS, GCP, Azure, ETL Processes, Analytical Communication, Interpersonal Skills, Big Data, Cloud Services

Industry

Software Development

Description

Job Description NIQ is looking for a Senior Data Engineer to join our Financial Services Engineering team. At NIQ, the Financial Services team uses alternative datasets to help global public equity investors (hedge funds, mutual funds, pension funds) make better investment decisions. We work with some of the largest hedge funds in the world. As a Senior Data Engineer, you will be at the cutting edge of the alternative data space where you will help maintain and improve our data infrastructure, which enables us to develop market research products and delivery data to our customers. In this role, you would also get the opportunity to work with world-class big data and cloud services, such as: AWS, Snowflake, Databricks, DBT, Airflow, and Looker. Apply now to start taking your career to the next level. Who we are looking for: You have a strong entrepreneurial spirit and a thirst to solve difficult challenges through innovation and creativity with a strong focus on results You have a passion for data and the insights it can deliver You are intellectually curious with a broad range of interests and hobbies You take ownership of your deliverables You have excellent analytical communication and interpersonal skills You have excellent communication skills with both technical and non-technical audiences You can work with distributed teams situated globally in different geographies You want to work in a team with a start-up mentality You can work well under pressure, prioritize work and be well organized. Relish tackling new challenges, paying attention to details, and, ultimately, growing professionally. Responsibilities: Refactor existing SQL stored procedures into modular, maintainable data pipelines using Apache Airflow Translate complex business logic into modern transformation frameworks (DBT/Snowpark/PySpark) 5+ years of hands-on programming experience with Python and SQL including familiarity with stored procedures, Snowflake, dbt, and Airflow. 5+ years of experience with PySpark to design, optimize and scale distributed data processing pipelines. Experience working on data modeling. Familiarity with a cloud provider (AWS, GCP, Azure) and their data infrastructure services (e.g., S3, EC2, etc.). Utilize programming languages like Python or JavaScript to build robust data pipelines and implement ETL processes. Collaborate with data engineers/analysts, business stakeholders, and IT team members on project goals. Qualifications Bachelor’s or Master’s degree in Computer Science, Engineering, or related field. 5+ years’ experience as a Data Engineer, Database Developer, or similar role. Experience working with Airflow, Pyspark, and Snowflake Strong knowledge and experience with SQL Server, Stored Procedures, and OLAP BI tools. Expertise in MDX or similar query languages for complex data analysis. Strong organizational skills with an ability to manage multiple projects and priorities. Additional Information Enjoy a flexible and rewarding work environment with peer-to-peer recognition platforms. Recharge and revitalize with help of wellness plans made for you and your family. Plan your future with financial wellness tools. Stay relevant and upskill yourself with career development opportunities. Our Benefits Flexible working environment Volunteer time off LinkedIn Learning Employee-Assistance-Program (EAP) NIQ may utilize artificial intelligence (AI) tools at various stages of the recruitment process, including résumé screening, candidate assessments, interview scheduling, job matching, communication support, and certain administrative tasks that help streamline workflows. These tools are intended to improve efficiency and support fair and consistent evaluation based on job-related criteria. All use of AI is governed by NIQ’s principles of fairness, transparency, human oversight, and inclusion. Final hiring decisions are made exclusively by humans. NIQ regularly reviews its AI tools to help mitigate bias and ensure compliance with applicable laws and regulations. If you have questions, require accommodations, or wish to request human review were permitted by law, please contact your local HR representative. For more information, please visit NIQ’s AI Safety Policies and Guiding Principles: https://www.nielseniq.com/global/en/ai-safety-policies. About NIQ NIQ is the world’s leading consumer intelligence company, delivering the most complete understanding of consumer buying behavior and revealing new pathways to growth. In 2023, NIQ combined with GfK, bringing together the two industry leaders with unparalleled global reach. With a holistic retail read and the most comprehensive consumer insights—delivered with advanced analytics through state-of-the-art platforms—NIQ delivers the Full View™. NIQ is an Advent International portfolio company with operations in 100+ markets, covering more than 90% of the world’s population. For more information, visit NIQ.com Want to keep up with our latest updates? Follow us on: LinkedIn | Instagram | Twitter | Facebook Our commitment to Diversity, Equity, and Inclusion At NIQ, we are steadfast in our commitment to fostering an inclusive workplace that mirrors the rich diversity of the communities and markets we serve. We believe that embracing a wide range of perspectives drives innovation and excellence. All employment decisions at NIQ are made without regard to race, color, religion, sex (including pregnancy, sexual orientation, or gender identity), national origin, age, disability, genetic information, marital status, veteran status, or any other characteristic protected by applicable laws. We invite individuals who share our dedication to inclusivity and equity to join us in making a meaningful impact. To learn more about our ongoing efforts in diversity and inclusion, please visit the https://nielseniq.com/global/en/news-center/diversity-inclusion Career Site Team: Technology

Responsibilities

Refactor existing SQL stored procedures into modular data pipelines using Apache Airflow and translate complex business logic into modern transformation frameworks. Collaborate with data engineers, analysts, and business stakeholders on project goals.