Sign up with

Already have an account? Log in here

Need some help?
Talk to us at +91 7670800001

DataBricks Manager Hiring at KPMG Nederland

Bengaluru, karnataka, India -

Full Time

Start Date

Immediate

Expiry Date

16 Apr, 26

Salary

0.0

Posted On

16 Jan, 26

Experience

10 year(s) or above

Remote Job

Yes

Telecommute

Yes

Sponsor Visa

Skills

Data Engineering, Databricks, Data Ingestion, ETL Processes, Spark, SQL, Python, Scala, Cloud Migration, Big Data, Delta Lake, MLflow, Data Processing, Analytical Pipelines, Agile Methodologies, CI/CD

Industry

Business Consulting and Services

Description

Bachelor's or higher degree in Computer Science, Data Engineering, or a related discipline, or equivalent (minimum 10+ years overall work experience). Expertise in designing and implementing high-performance data ingestion pipelines using Databricks and other relevant technologies. Proven track record of delivering and presenting proofs of concept for key technology components to project stakeholders. Development of scalable and reusable frameworks for ingesting, processing, and enriching datasets using Databricks. Integration of end-to-end data pipelines, ensuring data is efficiently transported from various source systems to target data stores. At least 7+ years of experience in developing data ingestion, data processing, and analytical pipelines using big data technologies, relational databases, and data warehouse solutions. Extensive hands-on experience implementing data ingestion and ETL processes on Databricks, leveraging technologies like Spark, Delta Lake, and MLflow. Expertise in Spark, SQL, Python, and Scala for data processing and analytics on Databricks. Strong knowledge of cloud migration strategies and tools, including Databricks-specific solutions. Familiarity with Big Data file formats and compression techniques. Proficiency in cloud architectures and understanding the pros and cons of different migration approaches. Proven ability to work independently under pressure while managing multiple priorities. Excellent communication skills, both written and verbal, with the ability to collaborate in a team environment. Experience working with engineering teams to define best practices in data engineering, including agile methodologies, coding standards, and CI/CD processes.

Responsibilities

The role involves designing and implementing high-performance data ingestion pipelines using Databricks and integrating end-to-end data pipelines. The manager will also develop scalable frameworks for processing and enriching datasets.