Senior Databricks Engineer, Madrid (on-site) – International client at The White Team
Tres Cantos, Community of Madrid, Spain -
Full Time


Start Date

Immediate

Expiry Date

22 Sep, 26

Salary

50000.0

Posted On

24 Jun, 26

Experience

5 year(s) or above

Remote Job

Yes

Telecommute

Yes

Sponsor Visa

No

Skills

Azure Databricks, Apache Spark, Python, Scala, SQL, Azure Data Factory, Unity Catalog, ETL, Azure Cloud Platform, Data Pipeline Design

Industry

IT Services and IT Consulting

Description
Senior Databricks Engineer, Madrid (on-site) – International client Job role: Senior Databricks Engineer. Required technical skill set: Azure Databricks + Apache Spark. Minimum experience: 6-10 years. Language: English (C1) MANDATORY. Location: Madrid (first 3-6 months on-site). DESCRIPTION: We are looking for a talented Senior Databricks Engineer with strong expertise in Azure Databricks and Apache Spark to design, build, and maintain scalable data pipelines. In this role, you will work with diverse data sources to deliver reliable, high-quality data solutions, ensuring data accuracy, integrity, and performance. You will collaborate closely with stakeholders, including data owners and analysts, to understand business requirements and implement efficient data processing solutions, while proactively monitoring and optimizing data pipelines within a cloud-based environment. Technical competences Must have: · Experience with Databricks-specific tools and features. · Experience with Datafactory. · Proficiency in programming languages such as Python or Scala for data processing on Databricks · Experience with Azure cloud platform. · Strong understanding of SQL. · Experience with ETL and processes, Unity Catalog. Good-to-have: · Certifications in Databricks or related cloud technologies. Responsibilities: Design, build, and maintain scalable and efficient data pipelines using Databricks. Integrate data from various sources (for eg. Azure storage account, SFTP, Fabric) using Apache Spark within Databricks. Implement processes and checks to ensure the accuracy and completeness of data. Work closely with data owners, analysts, and other stakeholders to understand data requirements and deliver solutions. Monitor data pipelines for issues and resolve them promptly to maintain data flow integrity. Language: · English (C1) MANDATORY. Location: · Madrid (first 3-6 months on-site). Salary: · 40.000-50.000€ SBA.
Responsibilities
Design, build, and maintain scalable data pipelines using Databricks and Apache Spark. Collaborate with stakeholders to integrate diverse data sources and ensure data accuracy and performance.
Loading...