Sr Data Engineer

at  PwC

JOB DESCRIPTION & SUMMARY

A career in our STEM line of Service, within Technology Strategy services, will provide you with the opportunity to help organisations
develop strategies that transform their technology capabilities and solve their most critical challenges. We focus on building technology enabled and agile operating models, planning their new enterprise architecture into a differentiating capability system that helps them win in the market, leveraging digital analytics to enhance the customer experience and optimising business operations, and using modern management techniques such as robotic
process automation and next generation sourcing strategies to help our clients get fit for growth.

As a Senior Associate, you’ll work as part of a team of problem solvers, helping to solve complex business issues from strategy to execution.

• Design, develop, and maintain scalable data pipelines and systems using Databricks and Python.
• Architect and implement data solutions leveraging the Microsoft stack (Azure, SQL Server, etc.).
• Collaborate with cross-functional teams to understand business requirements and deliver data-driven insights.
• Optimize and enhance data processing capabilities using Docker for containerization.
• Ensure data quality, integrity, and security across various systems and platforms.
• Troubleshoot and resolve data-related issues in a timely and efficient manner.
• Stay updated with the latest industry trends and incorporate best practices into the data engineering processes.
• Design, implement, and optimize ETL/ELT workflows using Azure Databricks and Python.
• Handle ingestion and transformation of structured, semi-structured, and unstructured data into Azure Data Lake or Synapse Analytics.
• Develop scalable solutions for batch and real-time data processing.
• Contribute to the architecture of modern data platforms leveraging Azure components such as Azure Data Factory, Data Lake, and Synapse Analytics.
• Expertise in SQL for querying and performance tuning.
• Familiarity with CI/CD tools like Azure DevOps or GitHub Actions.
• Understanding of data governance tools such as Azure Purview.
• Knowledge of data visualization tools (e.g., Power BI) is a plus.
• Experience with Big Data tools and streaming technologies (Kafka, Event Hub) is desirable..

All qualified applicants will receive consideration for employment at PwC without regard to ethnicity ; creed; color; religion; national origin; age; disability; sexual orientation; gender identity or expression; genetic predisposition or carrier status; marital; or any other status protected by law. PwC is proud to be an inclusive organization and equal opportunity employer.

QUALIFICATIONS:

• Bachelor’s or Master’s degree in Computer Science, Information Technology, or a related field.
• 5+ years of experience as a Data Engineer or related role.
• Proven experience as a Data Engineer or in a similar role, with a focus on Azure Databricks, Apache Spark and Python.
• Advanced proficiency in Python for data processing and automation.
• Strong proficiency in the Microsoft technology stack, including Azure (ADF, and SQL Server.
• Experience with Docker for containerization and deployment.
• Familiarity with data warehousing concepts and ETL processes.
• Excellent problem-solving skills and attention to detail.
• Strong communication and teamwork skills.Upper intermediate level of english.

PREFERRED QUALIFICATIONS:

• Certifications in Azure or Databricks.
• Experience with other cloud platforms like AWS or Google Cloud.
• Knowledge of big data technologies such as Spark or Hadoop.
• Familiarity with CI/CD pipelines and DevOps practices.
• Knowledge of orchestrator tools like Airflow
• Knowledge of REST APIs frameworks like FastAPI

ADDITIONAL JOB DESCRIPTION

• Understand the importance of have a correct information management
• Knowledge of Information Security and Data Protection
• Correct Information Security Management
  Education (if blank, degree and/or field of study not specified)
  Degrees/Field of Study required:
  Degrees/Field of Study preferred:
  Certifications (if blank, certifications not specified)

REQUIRED SKILLS

Apache Airflow, CI/CD, Docker (Software), English Language, ETL Tools, Microsoft Azure, PySpark, Python (Programming Language), RESTful APIs, Structured Query Language (SQL), Windows Azure Cloud

OPTIONAL SKILLS

Accepting Feedback, Accepting Feedback, Active Listening, Analytical Thinking, Base Erosion and Profit Shifting (BEPS), Business Tax, Communication, Consolidated Tax Returns, Corporate Structuring, Creativity, Economic Translation, Embracing Change, Emotional Regulation, Empathy, Financial Modeling, Financial Statement Analysis, Financial Structuring, Inclusion, Intellectual Curiosity, International Taxation, Learning Agility, Legal Document Review, Macroeconomics (Economics), Optimism, Self-Awareness {+ 11 more}
Desired Languages (If blank, desired languages not specified)
English

TRAVEL REQUIREMENTS

Not Specified

Please refer the Job description for details