Engenheiro de Dados AWS/Databricks at Jobgether

, , Brazil -

Full Time

Start Date

Immediate

Expiry Date

02 Oct, 26

Salary

0.0

Posted On

04 Jul, 26

Experience

5 year(s) or above

Remote Job

Yes

Telecommute

Yes

Sponsor Visa

Skills

Databricks, AWS, PySpark, SQL, Delta Lake, Medallion Architecture, ETL/ELT, Kafka, Structured Streaming, Dimensional Modeling, Data Vault, dbt, Delta Live Tables, Apache Airflow, Unity Catalog, LGPD

Industry

Internet Marketplace Platforms

Description

This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Engenheiro de Dados AWS/Databricks based in Brazil. This role is focused on building and evolving modern data engineering solutions within a cloud-native and governance-driven architecture. You will play a key part in designing and maintaining scalable data pipelines that support ingestion, transformation, and analytics across enterprise systems. The position is centered on Databricks and AWS ecosystems, with strong emphasis on data quality, cataloging, and compliance with governance standards such as LGPD. You will work with modern frameworks and distributed data processing technologies to ensure reliable and well-structured data products. In addition, you will contribute to observability, performance, and orchestration of data workflows in both batch and streaming environments. This is a highly technical and impactful role within a collaborative and global environment focused on data excellence and innovation. \n Accountabilities: Build and maintain scalable data pipelines for ingestion, transformation, and data curation Develop ELT/ETL workflows using PySpark and SQL within Medallion architecture (Bronze, Silver, Gold) Implement data quality rules, monitoring mechanisms, and remediation standards to ensure reliable datasets Perform data profiling and source system analysis to support governance and data cataloging initiatives Manage dataset cataloging and enforce data policies aligned with LGPD using Unity Catalog Integrate APIs, external data sources, and orchestration tools into end-to-end data workflows Support both batch and streaming ingestion processes using tools such as Auto Loader, Kafka, and Structured Streaming Collaborate on data modeling practices including Dimensional Modeling and Data Vault approaches Ensure observability and monitoring of pipelines to guarantee performance and reliability Requirements: Solid experience as a Data Engineer in production environments Strong hands-on experience with Databricks (Delta Lake) Advanced knowledge of PySpark and SQL Experience building ETL/ELT pipelines in cloud-based environments Knowledge of Medallion architecture and modern data lakehouse concepts Experience with batch and streaming ingestion (Kafka, Auto Loader, Structured Streaming) Understanding of data modeling techniques (Dimensional Modeling, Data Vault) Experience with dbt and/or Delta Live Tables (DLT) Familiarity with data quality frameworks such as Great Expectations or DLT Expectations Experience with pipeline orchestration tools like Databricks Workflows or Apache Airflow Knowledge of APIs and multi-source data integration Experience with data observability, monitoring, and troubleshooting pipelines English proficiency for communication in international environments (fluency preferred) Databricks certification and experience in data governance projects are a plus Knowledge of LGPD and Unity Catalog implementation is a strong plus Benefits: Flexible employment options (CLT or PJ) 100% remote work model Meal or food allowance Health and dental insurance coverage Life insurance Access to training platforms and continuous learning programs Discounts on courses, universities, and language schools Mentorship programs and career development support Wellness and healthcare benefits through partner networks Travel and lifestyle discount clubs Pet care benefits and additional employee support programs. \n How Jobgether works: We use an AI-powered matching process to ensure your application is reviewed quickly, objectively, and fairly against the role's core requirements. Our system identifies the top-fitting candidates, and this shortlist is then shared directly with the hiring company. The final decision and next steps (interviews, assessments) are managed by their internal team. We appreciate your interest and wish you the best! Why Apply Through Jobgether? Data Privacy Notice: By submitting your application, you acknowledge that Jobgether will process your personal data to evaluate your candidacy and share relevant information with the hiring employer. This processing is based on legitimate interest and pre-contractual measures under applicable data protection laws (including GDPR). You may exercise your rights (access, rectification, erasure, objection) at any time. #LI-CL1

Responsibilities

Design and maintain scalable data pipelines for ingestion, transformation, and curation using Medallion architecture. Ensure data quality, observability, and compliance with LGPD governance standards within the Databricks and AWS ecosystems.