Data Engineer / Barcelona (Hibrido) at Demo Datos

Barcelona, Catalonia, Spain -

Full Time

Start Date

Immediate

Expiry Date

03 Aug, 26

Salary

0.0

Posted On

05 May, 26

Experience

5 year(s) or above

Remote Job

Yes

Telecommute

Yes

Sponsor Visa

Skills

ELT Pipelines, Databricks, Unity Catalog, Azure Data Lake Storage, Azure Data Factory, Apache Spark, Delta Lake, Medallion Architecture, Lakehouse, Data Modeling, Python, PySpark, SQL, CI/CD, Version Control, English

Industry

IT Services and IT Consulting

Description

Descripción del puesto / Funciones Design, develop, and maintain ELT data pipelines. Deploy and manage data solutions in a cloud environment. Participate in data platform migration projects. Optimize performance of data processing jobs and clusters. Troubleshoot and resolve production issues. Collaborate with cross-functional data teams (architects, analysts, data scientists). Create and maintain technical documentation for data pipelines and processes. Implement data quality checks and validation processes. Develop data integration and processing workflows. Manage version control and implement CI/CD pipelines. Prepare training materials and support knowledge sharing within the team. Estudios Requisitos mínimos Minimum of 4 years of experience as a Data Engineer. Proven experience building, deploying, and maintaining ETL/ELT pipelines in cloud environments. Hands-on experience with Databricks and Unity Catalog. Experience with Azure data services, including Azure Data Lake Storage and Azure Data Factory. Strong knowledge of Apache Spark (job and cluster optimization), Databricks Workflows and Jobs, and Delta Lake. Solid understanding of medallion architecture and Lakehouse environments. Strong data modeling skills. Proficiency in Python (PySpark). Advanced SQL skills. Good understanding of development best practices, version control, and CI/CD. Professional level of English. Requisitos valorables Knowledge of Scala programming. Experience with other cloud platforms such as AWS or GCP. Experience building ETL processes from third-party APIs. Familiarity with data streaming technologies (e.g., Spark Streaming). Experience with Infrastructure as Code (IaC). Understanding of data governance principles. Idiomas English is a must Ubicación Barcelona (hybrid) ¿Por qué nosotros? Prioridad About us Pasiona Consulting es una consultora tecnológica, partner de Microsoft, dedicada al diseño, desarrollo e implementación de aplicaciones de software a medida para clientes de múltiples sectores.

Responsibilities

Design, develop, and maintain ELT data pipelines and cloud-based data solutions. Collaborate with cross-functional teams to optimize data processing and implement quality validation processes.